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ABSTRACT 


The U.S. military has faced imposing force structure reductions during the last decade. 
Complementing the force structure reductions, four rounds of Base Realignment and Closure 
(BRAC) have been authorized to reduce surplus infrastructure. However, as the BRAC 
process unfolds, environmental cost issues are being placed under ever increasing scrutiny. 
Military environmental restoration costs have risen sharply (and above expectations) in recent 
years, with the unanticipated cost growth occurring most visibly for bases on the BRAC lists. 

The complexity of the environmental clean-up enterprise, the numerous and varied 
regulatory requirements, and the uniqueness of individual installations have led to tremendous 
difficulty in effective budgeting. In today’s austere budgetary environment, a reliable 
expenditure model is essential to accurately demonstrate the resource requirements necessary 
to complete suitable environmental restoration and subsequent transfer/reuse of BRAC lands. 

To meet the need for an accurate and functional forecast model, thesis research 
developed and validated a tenable Department of the Navy (DoN) BRAC environmental 
restoration cost forecast model. The developed model utilized a comprehensive and inclusive 
multiple regression data analysis to arrive at the most statistically significant set of installation 
restoration parameters. A spreadsheet-based forecast model implementation procedure, 
incorporating empirically determined “rules of thumb” for estimating the parametric effects 
of BRAC initiation, serves as the culminating product of the research effort. 
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1. INTRODUCTION 


A. BACKGROUND 

The U.S. military has faced unrivaled force structure reductions during the last 
decade. Spurred by the end of the Cold War and unrelenting “balanced budget” fiscal 
pressures, military force structure and National Security budget authority have decreased 40% 
since the pro-military spending days of the mid-1980's [Ref 1], Complementing the force 
structure reductions, though lagging in both extent and duration, four rounds of Base 
Realignment and Closure (BRAC) have been sanctioned to reduce surplus infrastructure. 
Reducing and realigning base structure allows the Department of Defense to avert substantial 
long-term operational costs by eliminating excess capacity. 

As the Base Realignment and Closure process unfolds, environmental cost issues are 
being placed under ever increasing scrutiny by civilian communities, government agencies, 
and the Congress. The General Accounting Office (GAO) reports that several environmental 
restoration issues regarding base closure and realignment are in need of resolution. Among 
the chief concerns are determining accurate cleanup costs, timing appropriations with cleanup 
needs, and prioritizing available cleanup funds [Ref 2]. In addition, a purported major cause 
of installation cost overruns and delayed land transfers is under-forecasted environmental 
restoration expenditures at BRAC installations [Ref 3]. The resultant effect of overruns and 
delays has been the non-materialization of expected budgetary savings from base closure and 
realignment. 


1 


At the heart of the controversy is a long-standing Department of Defense (DoD) 
policy that excludes environmental restoration costs as a determinant in the base closure 
decision process. Environmental restoration costs are not included in DoD’s net present 
value analysis. Conventional wisdom contends environmental restoration expenditures are 
“sunk costs” since public law requires military bases to meet environmental standards 
regardless of operating status [Ref 4]. What is absent from this contention is the accelerated 
timetable and increased rate of resource consumption necessary to meet BRAC time line 
requirements and reap prompt BRAC savings. In fact, the alternatives DoD foregoes in 
redirecting limited funding to accelerate environmental restoration have some tangible value 
(i.e., opportunity cost) that ought to be acknowledged as part of a base closure decision. 

B. CURRENT SITUATION 

Environmental restoration costs have sky-rocketed in recent years. Additionally, 
unanticipated cost growth has occurred most visibly for bases that are scheduled to close 
[Ref 5]. BRAC annual environmental funding for military departments has grown from $304 
million in FY91 to $866 million in FY96 [Ref 6]. The fundamental complexity and multiple 
attributes of the environmental cleanup enterprise create significant challenges to effective 
budgeting [Ref 7], Assorted regulatory requirements and the uniqueness of individual 
installations further complicate restoration efforts and proper budgetary forecasting. In fact, 
past DoD budget requests have historically understated environmental costs [Ref 8]. Adding 
to the predicament. Department of the Navy BRAC facilities are accelerating environmental 
cleanup actions in order to expedite suitable property transfer or reuse. Without accurate cost 
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forecasting to complement the needed acceleration initiatives, the necessary fiscal resources 

will not be available to foster prompt property turnover and realize timely savings. 

Future base closings and realignments appear likely despite public rhetoric and 

sensational politicizing to the contrary. The much anticipated and highly regarded 

Quadrennial Defense Review (QDR) advocates two additional rounds of Base Realignment 

and Closure (BRACs V & VI). The QDR asserts; 

The downsizing of our infrastructure has fallen behind the downsizing of our 
force structure, in spite of four BRAC rounds. Since the first base closure 
round, force structure has come down by 33 percent and will have declined 
by a total of 36 percent when we finish the reductions under the QDR. 

During the same period, we have reduced domestic infrastructure by 21 
percent as measured by the replacement value of physical facilities. We 
cannot afford this waste of resources in an environment of tough choices and 
fiscal constraint. We must shed more weight. [Ref 9] 

Specifically, Defense Secretary Cohen has asked Congress for legislation authorizing 
the creation of a BRAC for additional base closure rounds in FY99 and FYOl. DoD 
estimates that each round of closures will result in $1.4 Billion in annual recurring savings, 
after up-front costs are paid [Ref 10]. It is these inexplicit “up-ffont costs” that constitute 
the BRAC environmental restoration program. Due to the up-front cost ambiguity and the 
perceived excessive environmental expenditures at current BRAC facilities, tremendous 
attention is expected to be directed toward environmental issues during these upcoming base 
closure deliberations. 

A credible and inclusive environmental cost forecasting model, embodying the 
beneficial effects of a steep BRAC environmental cleanup learning curve, will promote 
effective predictions for future costs. In today’s austere budgetary environment, a reliable 
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expendiaire model is essential to accurately demonstrate the resource requirements necessary 
to complete suitable environmental restoration and subsequent transfer/reuse of current as 
well as future BRAC lands. 

C. THESIS OBJECTIVES 

The thrust of the thesis involves the development of a comprehensive and tenable 
forecasting model for estimating environmental installation restoration costs at Department 
of the Navy (DoN) Base Realignment and Closure (BRAC) facilities. The causative 
forecasting model will be constructed via historical data and will incorporate a set of 
quantifiable installation parameters. 

As a follow-on to the forecasting model formulation, the measurable effects of a 
BRAC initiation on an installation’s key parameters will be ascertained. Initiation of a base 
closure and realignment action rapidly accelerates a facility’s environmental restoration 
timetable and thus begets a discernible increase in expenditure rate and resource consumption. 
Applicable parameter “deltas” will be empirically determined from an analysis of historical 
parameter changes experienced by facilities following the inception of base closure and 
realignment proceedings. The application of the parameter deltas to current/previous 
installation parameters will result in revised “expected” installation parameters. The revised 
parameter values can then be entered into the developed forecasting model to predict costs 
associated with future initiation of base closureXrealignment. 
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D. RESEARCH QUESTIONS 


To properly capture the separate but complementary thesis objectives, two primary 
thesis research questions are considered; 

1 . Is there a mathematical combination of quantifiable BRAC environmental 

restoration cost drivers that will yield an accurate budget forecasting model? 

2 . To what extent are the key installation parameters sensitive to the initiation of 

base closure and realignment actions at Department of Navy (DoN) facilities? 

In order to fully investigate causal factors necessitating environmental restoration 
expenditures, the following secondary thesis research questions are considered: 

1 . What legislative and regulatory programs drive DoN requirements for BRAC 

environmental restoration? 

2 . What is the history of DoN BRAC environmental restoration funding? 

3 . What is the historical variance between actual restoration costs and budgeted 

restoration costs? 

4 . What technologies and initiatives result in seemingly reduced environmental costs? 

E. THESIS SCOPE 

The goal of the thesis is the construction of an adaptable and practical forecasting 
model to predict environmental restoration costs at Navy installations on, or slated to be on, 
a base closure list. The causal forecasting model is built on quantifiable installation 
parameters and includes the predictable parametric consequences expected to be experienced 
by a DoN facility during the initiation of a BRAC action. 
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Data analysis is restricted to DoN BRAC installations for the period of FY89 through 
FY96, inclusive. Recent data (FY94-FY96) having individual anticipated future cumulative 
restoration expenditures exceeding one million dollars for each fiscal year are featured in 
model formulation due to the precipitous increase in the quality and quantity of available 
installation figures and parameters during these years. All data, including the earlier years, 
are used to discern the effects of base closure/realignment initiation on installation parameters. 

The robustness of the forecasting model is tested via calculational cost comparisons 
of predicted costs (using model) versus actual costs. Testing includes a sampling of non-DoN 
installation data for FY94-96 to assess envisioned broader model applicability. 

F. RESEARCH METHODOLOGY 

Thesis research entails two separate data methodologies to address each of the 
primary research questions. For the mathematical model formulation, the research method 
is primarily an inductive approach utilizing archival data to determine what measurable 
installation variables yield the best forecasting results. The strength of archival research lies 
in the suitability of factual data to statistical analysis and thus, the extrapolation of past trends 
into the future [Ref 11]. 

For determining the effects of base closure and realignment action on installation 
parameters, the research method is primarily a deductive research approach encompassing a 
mix of empirical and archival techniques. The intention of this methodology is to quantify an 
a priori hypothesis that assumes installation parameters are meaningfully affected (in the 
direction of contributing to higher costs) by the initiation of BRAC proceedings. 
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Research data collection encompasses environmental restoration cost data and a 
myriad of installation parameters for DoN facilities affected by the first four rounds of BRAC. 
Compiled data are utilized to build a viable mathematical cost forecasting model. Numerous 
combinations of data variables and calculational iterations are analyzed to determine the 
optimal blend of installation parameters, while preserving the simplicity needed for a widely 
applicable and workable model. The assembled forecasting model is effectively tested via a 
predicted versus actual cost comparative analysis to determine its estimation ability. 

To enhance and direct primary research efforts, a comprehensive environmental 
restoration program review assesses mission requirements, operating practices, and program 
funding associated with BRAC. Applicable legislative and regulatory requirements are 
studied to establish their causal effects as environmental restoration cost drivers. 

G. BENEFITS OF STUDY 

The definitive result of this research endeavor is a comprehensive and reliable 
mathematical forecast model to predict environmental restoration costs at BRAC installations. 
The broad applicability and effective employment of the forecast model yields the following 
benefits; 

1. Reveals critical cost drivers in the environmental restoration process. 

2. Assists in effective budgeting for environmental cleanup costs. 

3. Assists in the justification of requested funding and proper resource allocation. 

4. Quantifies the environmental cost impact on installations due to BRAC initiation. 

5. Assists in more accurate estimations of proposed BRAC savings and timetables. 
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H. ORGANIZATION OF THE STUDY 


The balance of the study is presented in the following seven remaining chapters; 

• Chapter II provides an overview of DoN’s implementation of the Defense 
Environmental Restoration Program (DERP) vis a vis BRAC. Analysis includes 
program backgrounds, DERP organization, DERP operations, and applicable 
legislative and regulatory requirements governing DoD’s environmental restoration 
actions. 

• Chapter EH presents DoD’s Defense Environmental Restoration Account (DERA) 
and Base Closure Account (BCA) funding histories and status. The chapter 
concludes with a comprehensive examination of the environmental restoration 
funding segment allocated and executed by DoN. 

• Chapter IV specifies the data collection and management process employed in 
formulating the mathematical cost forecasting model. The chapter concludes with 
a description and analysis of the developed multiple regression forecast model. 

• Chapter V examines the quantifiable effects of base closure and realignment 
initiation on installation variables. Installation parameter “rules of thumb” are 
presented to incorporate parametric effects into the developed forecast model 
precipitated by the conduct of BRAC proceedings. 

• Chapter VI details a spreadsheet-based “user’s guide” for implementing the 
developed environmental restoration cost forecasting model, as well as presenting 
the outcomes of forecast model validation and broad applicability testing. 
Comparative analyses involve developed forecast model estimates and DoN 
planning estimates versus actual costs. Additionally, Army and Air Force 
installation data are incorporated into the forecast model methodology to test 
model versatility. 

• Chapter Vn summarizes the results of the thesis research, highlights the project’s 
major research findings, and presents recommendations for further research and 
forecast model extension. 
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U. OVERVIEW OF THE ENVIRONMENTAL RESTORATION PROGRAM 


A. INTRODUCTION 

This chapter provides an overview of the Defense Environmental Restoration Program 
(DERP) as it applies to the Base Realignment and Closure (BRAC) process. The chapter 
describes the Department of the Navy’s (DoN) management of the DERP, its operating 
practices, applicable legislative/regulatory requirements, and program initiatives. 

The remainder of the chapter is divided into seven sections. Sections B and C 
illustrate the backgrounds of both the DERP and BRAC, respectively. Section D outlines 
DoN’s DERP organizational structure. Section E describes DoN’s operation of the DERP 
associated with base closure and realignment. Section F delineates applicable legislative and 
regulatory requirements driving DERP actions. Section G introduces DERP program 
initiatives germane to DoN BRAC environmental restoration costs. Section H summarizes 
the highlights of the chapter. 


B. DERP BACKGROUND 

The Defense Environmental Restoration Program (DERP) was formally established 
in 1984 to promote and coordinate efforts for the evaluation and cleanup of contamination 
at Department of Defense (DoD) installations. The DERP formalized two existing but 
unstructured DoD environmental programs. The first program was DoD’s Installation 
Restoration Program (IRP), established in 1975 to initiate study and cleanup of contaminated 
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sites in response to the guidance set forth in the National Oil and Hazardous Substances 
Contingency Plan (NCP). Spurred by the passage of the Comprehensive Environmental 
Response, Compensation and Liability Act of 1980 (CERCLA), the second unnamed existing 
program intensified the assemblage and evaluation of data pertaining to potentially hazardous 
activities at DoD installations. Funding in the early years of the DERP consisted of yearly 
line-item appropriations for FY84 through FY86. 

At the outset of the initial DoN cleanup programs, CERCLA and the NCP did not 
specifically apply to federal facilities. Passage of the Superfund Amendments and 
Reathorization Act (SARA) in 1986 oflScially brought all federal facilities under the CERCLA 
program umbrella. Executive Order 12580 on Superfimd Implementation, signed in January 
of 1987, assigned responsibility to the Secretary of Defense for carrying out the DERP within 
the overall framework of SARA, CERCLA, NCP, and the EPA’s Superfund program. To 
execute the program, SARA also provided separate funding via a special transfer account, the 
Defense Environmental Restoration Account (DERA). [Ref 12] 

In May 1993, DoD created the position of Deputy Under Secretary of Defense for 
Environmental Security to centrally manage the DERP, develop and defend the DERA 
budget, and allocate funds to all the services. To facilitate effective management of the 
program, DoN has been delegated both the operational and, most recently, the budgetary 
responsibility to carry out all DERP functions on property it manages. Additionally, in 
reaction to escalating concerns regarding environmental restoration issues, the Administration 
began expressing concern in July 1993 that closing military bases had been cumbersome and 
slow, with environmental cleanup and other processes taking many years to complete. In 
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response, the Administration announced a five-part program to help accelerate cleanup and 
community reuse of closing installations. [Ref 13] 


C. BRAC BACKGROUND 

Starting in 1988, DoD sought to achieve material savings by closing and realigning 
military facilities. DoD concluded a reduction in military force structure justified a reduction 
in military infrastructure. To elevate this troublesome process beyond parochial concerns. 
Congress established the non-partisan Commission on Base Realignment and Closure (BRAC 
I). [Ref 14] The culmination of the Commission’s work for BRAC I was the Base Closure 
and Realignment Act of 1988 (Public Law 100-526), signed October 24, 1988. The law was 
intended to provide procedures to facilitate the closure and realignment of obsolete or 
unnecessary military installations. BRAC I actions were to be initiated before January 1, 1990 
but no later than September 30, 1991. All closures and realignments were to be complete by 
September 30, 1995. [Ref 15] 

In similar fashion, for similar reasons. Congress chartered additional commissions to 
meet in 1991, 1993, and 1995 (BlL\Cs II, III, and IV). Embodying these remaining BRAC 
rounds in a singular statute (The Defense Base Closure and Realignment Act of 1990 - Public 
Law 101-510) facilitated the consistent application of commission processes and timetables. 
Through a comparable legislative review and approval procedure as in BRAC I, the next three 
commissions required congressional action by September of their respective years before 
becoming legally binding. The Secretary of Defense then had two years to initiate closure and 
realignment proceedings and only six years to complete all actions. [Ref 16] 
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To avoid potential DoD reluctance in absorbing substantial up-front BRAC costs, 
Congress created the Defense Base Closure Account (BCA) to provide funding for unique 
closure and realignment expenditures. It was Congress’ intention that separate appropriations 
earmarked for BRAC would provide for independent financial decisions and avert competition 
between active and closing installations for coveted Operations and Maintenance (O&M) and 
Military Construction (MILCON) funds. The majority of BCA funding applies to military 
construction, relocation, and environmental restoration expenses. Currently, language in the 
budget assigns a ceiling on the amount of BCA funds allowed to be expended for 
environmental restoration. DERP funds, however, cannot be used to supplement ceiling 
shortfalls since all environmental costs associated with BRAC must, by law, come solely from 
the BCA. 

The first four BRAC rounds have directed the closure, realignment, and/or relocation 
of several hundred active and reserve military installations and support facilities. Included in 
the process is the closure of nearly 100 major domestic military bases [Ref 17] and the 
realignment of over 50 other major facilities. Through the BRAC processes, the Department 
of the Navy has seen the closure or realignment of over 50 major installations and over 200 
minor installations and support facilities [Ref 18]. Of these actions, the most substantial 
number of Navy installations was affected via BRAC III of 1993. 

It is imperative to understand that environmental restoration efforts for all sites at 
BRAC installations are also encompassed under the DERP authority. The only material 
difference between DERP actions at active and closing facilities is the source of funding. 
Under the BRAC statutes (Public Laws 101-105 and 100-526), sites that would normally 
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qualify for DERA monies are funded out of a separate BRAG account but are still considered 
part of the DERP. To date, DoD/DoN has managed four rounds of base closure and 
realignment in this manner. 


D. DON DERP ORGANIZATION 

As previously cited, the Deputy Under Secretary of Defense (Environmental Security) 
delegates DERP operational control to each of the services. For DoN, the DERP policy 
direction and oversight responsibility falls on the Assistant Secretary of the Navy (Installations 
and Environment). Policy promulgation is further subordinated to the Chief of Naval 
Operations (CNO) and the Commandant of the Marine Corps. More detailed operational 
governance is provided by the Naval Facilities Engineering Command (NAVFACENGCOM). 

Actual DERP implementation is carried out by the affected Navy and Marine Corps 
activities with direct management by NAVFACENGCOM Engineering Field Divisions (EFD). 
There are ten EFDs positioned throughout the United States to provide complete support 
coverage of DoN facilities. Remedial Project Managers (RPM) from the regional EFD work 
closely with individual installations, regulators and stakeholders to plan, prioritize, budget, 
and coordinate DERP execution. The regionally centralized approach provides enhanced 
partnering capabilities with territorially specific regulators and stakeholders through program 
consistency, eflBciency, economies of scale, and consistent policy. [Ref 19] Figure 2-1 on the 
following page depicts DoN’s DERP organizational structure. 


13 


Assistant Secretary of the Navy 
(Installations & Environment) 


Echelon II 
Commands 



Chief of Naval Operations 


Commandant of the 

(Environmental Protection, 


Marine Corps 

Safety &Occupational 


(Facilities & Services) 


#;, yNavy facilities 
En^neering Command 
gO^OTAGENGGOM) 









DoN IRP Responsibility Key: 

Polic>^ Promulgation 

1 1 

Program Management 

nu 

Program Implementation 



Figure 2-1. The Department of the Navy's IRP Organizational Structure 


14 




























































E. 


DON DERP OPERATIONS 


Today’s Navy and Marine Corps facilities occupy roughly four million acres of land 

in the United States alone. Continued access to these lands, their adjoining coasts, and the 

airspace above them is a central goal of DoN’s environmental program in support of our 

overall national security strategy. DoN’s perspective on DERP is best summarized by 

statements from the Assistant Secretary of the Navy’s (Installations & Environment) office; 

Readiness and protection of the environment are inextricably linked.... Our 
care for the natural resources entrusted to us by the American people will 
ensure our continued access to air, water and land necessary to support 
operational readiness, and the defense of our national interests. It will also 
ensure that our sailors and marines have environmentally safe living and 
training conditions. [Ref 20] 

The vast preponderance of the Navy’s environmental effort consists of assessing, 
characterizing, cleaning up, or controlling past contamination in support of CERCLA 
restoration at active and closing facilities. The Installation Restoration Program (IRP) is the 
central CERCLA mechanism of DoN’s DERP program and historically accounts for an 
overwhelming majority of all DERP expenditures. The focus of the IRP is to ensure public 
health and environmental threats are eradicated via the cleanup of contamination associated 
with past hazardous waste disposal, thus suitably restoring property for future use or reuse. 

It is important to restate that IRP directives apply equally to both active and closing 
installations. In fact, the heightened interest in BRAC restoration issues revealed itself in 
recent Base Closure Account (BCA) language by specifically directing DoD to ensure that 
the restorations of any property made excess to the needs of the DoD as a result of BRAC 
be carried out “as soon as possible with funds available for such purpose.” [Ref 21] 
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AU sites on Navy controlled property within the United States and its territories fall 
under the domain of the Installation Restoration Program. The ERP consists of a series of 
phases to identify, characterize, and cleanup hazardous waste. In broad terms, the ERP phases 
are grouped into two general categories; “Investigation” and “Cleanup.” The Investigation 
category involves Preliminary Assessment (PA), Site Inspection (SI), Remedial Investigation 
and Feasibility Study (RI/FS). The Cleanup category involves Remedial Design (RD), 
Remedial Action (RA), and Interim Remedial/Removal Actions (IRA). Although not 
technically part of IRP cleanup, it should be recognized that environmental Operations and 
Maintenance (O&M) and Long-Term Monitoring (LTM) are frequently included in the 
cleanup category for costing purposes. The highlights of each major restoration phase 
(reviewed in the following subsections) were compiled from the most recent DoN Five-Year 
Environmental Restoration Plan for Fiscal Years 1997-2001 [Ref 22]. 

1. Preliminary Assessment (PA) 

The IRP process is nominally initiated with a Preliminary Assessment (PA) conducted 
by the Naval Facilities Engineering Command (NAVFACENGCOM). The purpose of the PA 
is to identify potentially contaminated sites at the installation under study. The PA consists 
of the collection and review of readily available and existing information on past hazardous 
waste disposal operations or hazardous material spills occurring at the facility. The gathered 
information is evaluated to determine the potential for hazardous waste contamination. The 
evaluation considers pathways of exposure, possible receptors, the contamination source, the 
nature and threat of contaminant release, and the plausibility for removal or treatment. 
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2 . 


Site Inspection (SI) 


A Site Inspection (SI) is performed for all sites identified as potentially contaminated 
via the PA procedure. The purpose of the SI is to augment PA data collection and generate, 
if necessary, sampling and other field data to determine if further investigation or action is 
warranted. The SI consists of an on-site investigation to ascertain the nature and extent of 
potential or actual contamination release. 

Information from the SI and PA are used by the Environmental Protection Agency 
(EPA) to evaluate an installation’s potential inclusion on the National Priorities List (NPL). 
The NPL is a national list of sites, both public and private, that pose the greatest threat to 
human health or the environment. Within DoN, a particular site’s NPL status applies to the 
entire installation, unless the EPA and DoN can concur on specific exclusion of certain 
installation property. 

The DoN, in accordance with DoD directives, enters into a Federal Facilities 
Agreement (FFA) with the cognizant EPA region as soon as possible after NPL initiation. 
In many instances, affected states are included as participating parties in the FFA. The FFA 
specifies the roles and responsibilities of the regulatory agencies and DoN, as well as 
establishing milestones for future cleanup actions. 

3. Remedial Investigation / Feasibility Study (RI/FS) 

When a site is verified to be contaminated by the SI, the site then advances to a 
Remedial Investigation / Feasibility Study (RI/FS). The purpose of the RI/FS is to quantify 
the nature and extent of the threat posed by the contamination and, when appropriate. 
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evaluate proposed remedies. The RI portion of this phase is a detailed study involving a 
variety of investigative sampling and analytical procedures. RI includes the collection of soil, 
air, water, and other samples necessary to determine contaminant characteristics, hazards, and 
exposure routes. 

The Feasibility Study (FS) portion uses generated RI data to identify potential cleanup 
actions. During the FS, a number of remedial alternatives are conceived and screened to 
evaluate their ability to meet a range of remediation factors, including technical and regulatory 
requirements. After consideration of public and regulatory agency comments, the RI/FS is 
concluded by the selection of a remedy method or a recommendation for no further action. 
Completion of the RI/FS phase marks the end of the IRP Investigation category. 

4. Remedial Design (RD) 

Once a site is identified in the RI/FS as requiring cleanup action, the site moves into 
the Remedial Design (RD) phase. The purpose of the RD phase is to prepare all technical 
documentation and specifications fundamental to the successful implementation of the agreed 
upon contaminant cleanup action. The initiation of RD phase operations marks the beginning 
of the IRP Cleanup category. 

5. Interim Remedial Actions (IRAs) and Removals 

Interim Remedial Actions (IRAs) and Removals may be undertaken at any point 
during the investigation or cleanup of a site. The flexibility of these actions is intended to 
allow rapid response to contaminant release that presents an imminent or substantial threat 
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to human health or the environment. ERAs also serve to quickly reduce overall site risk and 
to stabilize a site until final cleanup action can be accomplished. On an increasing basis, DoN 
is utilizing IRAs as a tool to expeditiously react to site contamination, reduce investigation 
costs, and accelerate the cleanup process. 

6. Remedial Actions (RA) 

Remedial Action (RA) is the actual construction, operation, and implementation of 
the designated final cleanup action. In many instances, the final remediation action may 
include long-term operations and monitoring of treatment systems that extend well into the 
future. In these cases, the RA phase is considered complete when the selected remedy is in 
place and is functioning as intended. 

The question of “how clean is clean?” is a widely contested issue among all 
participants in the environmental restoration business. The argument stems from deviating 
opinions on how much remediation is required to clean contaminated parcels. The answer 
depends largely on who sets the remediation standards and what criteria are used to measure 
success. Per the Community Environmental Response Facilitation Act of 1992 (CERFA), the 
ultimate remediation arbiter is the EPA or the state environmental regulators. Their decision 
basis, however, can be negotiated and thus may be different for each parcel. 

The cleanup level decision is much easier for bases not facing closure. Active 
installation cleanup is done to satisfy current use standards based on the types of operations 
conducted in that area. For closing bases the cleanup issue is far more complicated. CERFA, 
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contrary to historical practices of transferring federal property “as is”, requires the 
government to retain responsibility for all remediation actions. Secondly, it is recurrently 
unclear whether closing bases should be cleaned to current use standards, planned reuse 
standards, or restored to original property condition. These difficulties encountered in the 
cleanup of BRAC parcels can lead to lengthy remediation delays, elaborate reuse 
arrangements, and expensive remediation rework. 

F. LEGISLATIVE AND REGULATORY REQUIREMENTS 

In the past, military and civilian industries were not particularly conscientious about 
hazardous contaminant use and disposal. As public rhetoric and citizen education on the 
dangers of environmental contamination intensified, so too did the amount and extent of 
regulatory mandates. These numerous and varied laws and regulations are the engine that 
drives environmental control and restoration endeavors. 

Environmental programs attempt to convert all applicable statutes and regulatory 
requirements into a workable process. In fact, as was previously described, DoN’s entire 
environmental restoration program was conceived and launched as a response to two major 
legislative actions - the Comprehensive Environmental Response, Compensation and Liability 
Act of 1980; and the National Oil and Hazardous Substances Contingency Plan. The present 
form of the Navy’s IRP strives to encompass all prescribed edicts spelled out in numerous 
legislative and regulatory requirements. Since mandated requirements drive IRP structure and 
operations, they are also chiefly responsible for program costs. In fact, DoD has stated to 
Congress that legislation and regulations have “served as the basis for most policies and 
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decisions that aflFect priorities and funding of the program.” [Ref 23] The subsections below 
summarize pertinent laws and regulations weighing significantly on DoN’s environmental 
restoration enterprise. Information contained in the subsections was abstracted from DoN’s 
Five-Year Environmental Restoration Plan for Fiscal Years 1997-2001 [Ref 24]. 

1. CERCLA 

The Comprehensive Environmental Response, Compensation and Liability Act of 
1980 (CERCLA), commonly referred to as the Superfimd Act, gave federal agencies 
authority to respond to the release or substantial threat of release of hazardous substances 
into the environment. CERCLA also extends its authority to situations where contaminants 
and pollutants present imminent and substantial danger to public health. Additionally, 
CERCLA (and its follow-on amendments) requires that other federal laws and more stringent 
state regulations be considered when conducting response actions. Examples of such laws 
that may be considered as Applicable and Relevant or Appropriate Requirements (ARARs) 
include: the Resource Conservation and Recovery Act (RCRA); the Toxic Substance Control 
Act (TSCA); the Clean Air Act (CAA); and the Safe Drinking Water Act (SDWA). 


2. NCP 

The National Oil and Hazardous Substances Contingency Plan (NCP) is the base 
regulation that implements the statutory requirements of CERCLA and the Clean Water Act. 
The NCP provides organizational structure and operational procedures in preparing for and 
responding to discharges of oil and the release of hazardous substances, pollutants, and 
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contaminants. The NCP also establishes initial response action and notification procedures 
for the release of a reportable quantity of hazardous substances. The NCP was the impetus 
behind the formation of the IRP. DoD/DoN must comply with the NCP regulation as law. 


3. NEPA 

The National Environmental Policy Act of 1970 (NEPA) requires federal agencies to 
consider environmental impacts of proposed “major actions.” The law defines a specific 
decision-making process that must be followed to determine such impacts. Until an agency 
completes its NEPA review, work on a proposal cannot be initiated. Major actions having 
a significant effect on the environment require an Environmental Impact Statement (EIS). 
Major actions for which environmental impact is not known or is insignificant require an 
Environmental Assessment (EA). Federal Register notices are required for any EIS and EA. 
Federal agency decisions under NEPA are subject to review by the courts. 

Conventionally, BRAC proceedings are considered major actions and are thus subject 
to NEPA. Additionally, when IRP operations follow the NCP and fulfill public participation 
requirements, then the IRP is deemed to have complied with NEPA. To help clarify early 
misconceptions with the NEPA-BRAC linkage, the Base Closure and Realignment Act of 
1990 included specific language to address the NEPA issue. In general, the 1990 BRAC act 
stated that NEPA does not apply to the closure decision but does apply to the property 
disposal process and the relocation of functions from closed or realigned facilities. [Ref 25] 
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4. 


SARA 


The Superiund Amendments and Reauthorization Act of 1986 (SARA) reauthorized 
CERCLA funding and amended the authorities and requirements of CERCLA and other 
associated laws. Congress extended the authorization of CERCLA since the program’s 
authority was lapsing and its charter was far from complete. 

SARA is divided into five major titles. Titles I and III are most directly related to the 
DERP and the IRP. Title I, section 120, established special funding (DERA) to pay for the 
cost of DoD responses to hazardous waste sites. Title III established the Environmental 
Planning and Community Right to Know Act of 1986. Although Title III does not directly 
apply to federal agencies, it is DoD’s policy to comply with its provisions to the maximum 
extent practicable. Under Title III, facilities are required to train personnel in hazardous spill 
response, notify local emergency response planners of hazardous substances on the property, 
and upgrade their Spill Prevention, Control, and Countermeasures (SPCC) plans. 

5. CERFA 

The Community Environmental Response Facilitation Act of 1992 (CERFA) amends 
CERCLA and requires the Federal Government to identify real property on each facility 
which is not contaminated. This process, commonly referred to as “parcelization”, is intended 
to identify land that offers the greatest opportunity for expedited reuse and redevelopment 
by the community. The identified parcels of real property must be either free from hazardous 
substances and petroleum products or the remediation of contamination must be expedited 
to facilitate transfer to the public. 
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The CERFA law states that federal findings must be concurred with by the EPA (for 
an NPL site) or the appropriate state officials (for non-NPL sites). Concurrence of real 
property applies equally to BRAC and non-BRAC facilities. An additional stipulation 
commands BRAC facilities to both identify parcels and receive concurrence reports within 
18 months after being designated a BRAC installation. 

The Environmental Baseline Survey (EBS) is the DoD process utilized to evaluate and 
identify a parcel’s environmental condition. The EBS process has been standardized among 
the services via DoD guidance and defines seven “Area Types” for categorizing of property. 
The EBS also serves as the conclusive property status document required for government real 
estate transactions under the Findings of Suitability to Lease (FOSL) and Findings of 
Suitability to Transfer (FOST) programs. 

When the property is transferred, the federal government retains responsibility for any 
remediation or response action found to be necessary after the date of transfer. Long-term 
monitoring and environmental operations and maintenance will not prevent the transfer of 
federal property, as long as planned remedial action is complete, or installation of approved 
remedial design is complete and proper remedy operations have been demonstrated. 

G. DERP INITIATIVES 

Program initiatives are the responses commissioned to achieve compliance with the 
environmental laws and regulations in an ever-changing climate. As a consequence, program 
initiatives drive DERP composition and operations and are thus directly attributable to 
program expenditures. DoD continually takes measures to optimize the quality, speed and 
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cost of environmental restoration. Practices are changed in order to reduce environmental 
risk, achieve faster cleanups, and realize optimal restoration progress with a decreasing public 
tax dollar funding base. In increasing fashion, the initiatives have been planned and conducted 
in close concert with federal, state and local regulators, as well as stakeholders, communities, 
and private industry. 

The most sweeping recent initiatives were born out of the Administration’s 1993 five 
part Community Reinvestment Program striving to accelerate the economic revitalization of 
communities afiected by BRAC actions. Fast Track Cleanup, one of the five major initiatives 
of the President’s plan, has proven to be a leading force in DoD environmental restoration 
endeavors. DoD has developed several Fast Track implementation guidance instructions over 
the past few years in cooperation with the EPA and several state regulators. Key Fast Track 
issues pertinent to DoN restoration efforts are outlined below. Descriptions are summarized 
from statements by the Deputy Under Secretary of Defense (Environmental Security) 
presented before the Senate Appropriations Committee, Subcommittee on Defense, in 
hearings addressing Environmental Security Programs [Ref 26]. 


• BRAC Cleanup Teams (BCTsT Teams consisting of DoD, EPA, and state 
environmental professionals are created at each major closing base to cooperatively 
develop and review all cleanup plans. BCTs seek to accelerate remedial efforts 
needed to prepare real property for transfer and reuse. 

• Parcelization : Under CERFA authority, DoD makes available clean parcels of land 
for immediate transfer to local communities while other contaminated parcels 
continue to be remediated. To expedite the availability of parcels requiring 
minimal cleanup actions, DoD and the EPA have partnered to develop model lease 
language. 
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• NEPA Reviews and Re-Use : To facilitate rapid property transfer, NEPA 
documents are to be completed within 12 months after community submission of 
its final Re-use plan. The Re-use plan serves as the “major action” addressed in the 
NEPA analysis. The subsequent NEPA findings, in turn, fulfill statutory 
requirements for both closure and re-use actions. 

• Indemnification : DoD, as provided by law, ensures future property users at closing 
bases are indemnified from liability for past contamination. The initiative’s intent 
is to speed property transfer by eliminating stakeholders’ future liability anxieties. 

• Restoration Advisory Boards fRABsl : RABs consist of DoD, EPA, and local 
regulatory officials reflecting diverse interests at all major closing bases. RABs 
serve as a forum for public comment and exchange of restoration information, as 
well as give stakeholders the opportunity to participate in the cleanup process. 
Underscoring RAB program importance, recent Defense Authorization Acts 
require annual reporting on the activities of, and funding for, each installation’s 
RAB [Ref 27]. 


Aside from the Fast Track Program, other notable initiatives significantly affect DERP 
operations. Two of the more pivotal undertakings are the Relative Risk Reduction Program 
and the devolvement of program funding. The Relative Risk Reduction Program initiative 
classifies installation sites into several categories (high, medium, low, not evaluated, not 
required) to prioritize and sequence work, produce quantifiable performance measures, and 
provide a basis for justifying requirements and funding. 

The initiative to devolve DoD’s DERA to each of the services in FY97 developed out 
of growing program size and the maturing nature of the services’ partnering efforts with the 
regulatory communities. Devolvement seeks to improve planning, budgeting, accountability, 
and oversight by forcing the consideration of environmental restoration demands with other 
mission requirements during the planning, programming, and budgeting (PPBS) cycle. Under 
devolvement, however, the Base Closure Account (BCA) remains as currently structured. 
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It is imperative to mention that most program initiatives encompass restoration efforts 
at BRAC facilities, especially the profound emphasis on cleanup/remediation actions while 
maintaining only necessary investigation work. In addition, both technology implementation 
and research and development play an expanding role in the DERP/BRAC execution and 
costing. Several technological ventures greatly influence restoration operations through 
active technology transfer and innovative cleanup designs. Unfortunately, uncompromising 
budgetary constraints and hurried timeline restrictions provide constant challenges and 
hamper progress in the technology area. The broad subjects of restoration technology and 
research and development provide ample opportunities for meaningful examination, yet these 
topics fall beyond the scope of research intended for this thesis. 


H. SUMMARY 

Chapter II provides a chronological perspective and the operational framework of the 
Defense Environmental Restoration Program (DERP) vis a vis Base Realignment and Closure 
(BRAC). The DERP and BRAC background reviews establish each program’s administrative 
scheme and the historical influences that configure their functionality. 

The description of current DoN DERP organizational and operational systems 
provides the fundamental framework crucial to suitably analyzing program oversight, 
implementation, and execution. Of specific importance is acknowledging the functional 
differences among the categories and phases associated with environmental restoration 
efforts. Each category and phase has certain requirements and procedures that uniquely steer 
its activities, and ultimately, its expenditures and expenditure rate. In general, the phases of 
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Investigation cover vast amounts of real estate, require substantial time to complete, and 
serve as abase for follow-on actions. The Cleanup phases are characterized by concentrated 
and high cost end-product activities. Recent trends have suggested that time consuming and 
sequential Investigation activities can be reduced in favor of accelerated Cleanup actions. 

The applicable legislative and regulatory requirements governing the DERP and 
BRAC processes unequivocally underpin program formation and initiatives. The most 
notable regulatory mandates include the National Environmental Policy Act of 1970 (NEPA), 
the Comprehensive Environmental Response, Compensation and Liability Act of 1980 
(CERCLA), the Superfiind Amendments and Reauthorization Act of 1986 (SARA), and the 
Community Environmental Response Facilitation Act of 1992 (CERFA). CERCLA (and 
SARA) formed the basis for the DERP IRP process and their mandates created much of the 
existing structure. NEPA requirements drive many of the program operations and initiatives 
to satisfy its evaluation and reporting commitments. CERFA, in mandating DoD’s 
parcelization efforts, is the most recent major legislation affecting BRAC. 

Program initiatives are generally the result of legislative and regulatory compliance 
in a dynamic political and budgetary situation. Examining DERP initiatives reveal trends in 
program composition and operation, ultimately unveiling the environmental restoration cost 
drivers. Notwithstanding the sweeping drive to accelerate remediation actions over 
investigation actions, several initiatives dominate the program. The Fast Track Cleanup 
initiative comprises the vast majority of BRAC environmental restoration undertakings. 
Additionally, the recent Relative Risk Reduction Program initiative provides a framework for 
prioritizing work, measuring performance, and justifying requirements and funding. 
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m. ENVIRONMENTAL RESTORATION PROGRAM FUNDING 


A. INTRODUCTION 

The Department of Defense (DoD) financed nearly $15 billion through FY96 in 
environmental restoration acti\dties through the Defense Environmental Restoration Program 
(DERP). The budget history of the DERP demonstrates a growing preoccupation with 
environmental and public health concerns. For example, DoD funded just $150 million in 
FY84 for environmental restoration efforts at military facilities. In contrast, DoD spent nearly 
ten times that figure ($1.4 billion) in FY96, with a peak yearly expenditure of almost $2 
billion in FY94. 

Through FY96, Congress provided funds for DoD environmental restoration in two 
distinct accounts; approximately $11.4 billion in the Defense Environmental Restoration 
Account (DERA) for operational facilities and approximately $3.5 billion in the Base Closure 
Account (BCA) for BRAC installations [Ref 28]. Commencing in FY97, the DERA monies 
are granted in five separate service accounts in accordance with the program’s devolvement 
initiative. The BCA, however, continues to be executed in its customary fashion. 

It is not uncommon, nor inconsistent, to see environmental restoration expenditure 
totals expressed in the combined terms of the DERA and the BCA. In fact, all of the DoN 
BRAC installations utilized in the detailed analysis portion of this thesis expended DERA 
funds prior to being placed on their respective BRAC lists. Consequently, the cumulative 
year-to-date expenditure totals employed in model formulation and evaluation consist of both 
DERA and BCA funds. It is important to recognize that once a facility has initiated BRAC 
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proceedings, it is then required by law to only allocate BCA environmental funds for 
subsequent restoration efforts. Figure 3-1 below illustrates DoD’s environmental funding 
history from FY84-FY96. 


DoD ENVIRONMENTAL FUNDING 
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Figure 3-1. DoD Environmental Restoration Funding History (FY84-FY96) 

The remainder of the chapter is divided into four sections. Section B presents DoD’s 
DERA funding history and status. Section C presents DoD’s BRAC environmental funding 
history and status. Section D illustrates DoN’s environmental restoration funding situation. 
Section E summarizes the highlights of the chapter. 
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B. 


DOD DERA FUNDING 


The Department of Defense has dramatically expanded its environmental restoration 
operations and funding in the 1990's to combat rapid growth in the number of identified 
contaminated sites, escalating regulatory requirements, and the general movement of the 
program into the more complex and costly remediation stages. Figure 3-2 below underscores 
both the accelerated growth of the DERA, as well as, the realities of inconsistent funding. 


DoD DERA FUNDING TREND 
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Figure 3-2. DoD DERA Funding Trend (FY84-FY99) 
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Although required to satisfy escalating requirements, the steep funding slope between 
FY90 and FY94 was not easily managed. The steep funding curve merged with a coincidingly 
steep restoration learning curve to present difficult challenges in the planning, programming, 
budgeting, and execution of the program. In FY95, when the program had achieved critical 
momentum and execution capabilities were in line with funding levels, DERA funding was 
significantly reduced below that needed to fund planned restoration activities. [Ref 29] 

The undulating nature of the DERA demonstrates the consequences of inconsistent 
yearly appropriations. Maturing programs such as the DERP are best served by stable 
funding commensurate with forecasted operations. In this regard, stable funding does not 
necessarily connote level funding but, rather it connotes manageable change consistent with 
future planned expenditures. Manageable funding variations are especially critical to the 
multi-year nature of environmental restoration operations since there is a direct correlation 
between appropriations and execution in one year and continuing restoration progress in 
subsequent years. [Ref 30] 

The configuration and amounts of Figure 3-3 on the following page highlight the 
“cleanup versus investigation” initiative influencing environmental restoration at both active 
and closing installations. As portrayed in the figure, cleanup costs are increasing while 
investigation and management costs are decreasing appreciably. DoD’s approach is aimed 
at maintaining the momentum gained in recent years and establishing program remediation 
stability in the face of funding reductions. The program attempts to complete operations in 
accordance with statutory requirements by prioritizing cleanup and investigation work on a 
relative risk reduction basis. [Ref 31] 
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DoDDERA FUNDING PROFILE 
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Figure 3-3. DoD DERA Funding Profile (FY94-FY99) 

The categories portrayed in Figure 3-3 above correspond to those described in 
Chapter II. As a means of summarization. Figure 3-3 categories are recounted below. The 
Cleanup category includes: Interim Remedial Actions (IRAs) and Removals; Remedial Action 
(RA); Remedial Design (RD); environmental Operations and Maintenance (O&M); and Long- 
Term Monitoring (LTM). The Investigation category includes; Preliminary Assessment (PA), 
Site Inspection (SI), and Remedial Investigation/Feasibility Study (Rl/FS). The Management 
category includes; program administration costs such as travel, training, and support costs, 
as well as the reimbursement of outside entities for technical services. 
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c. 


DOD BRAC ENVIRONMENTAL FUNDING 


Funding for DoD’s BRAC environmental program is part of the overall Base Closure 
Account (BCA) which supplies six subaccounts, including one for the BRAC environmental 
restoration effort. DoD annually presents Congress with a detailed budget submission to 
justify requested BCA funds. The submitted budget is utilized by Congress to make separate 
appropriations for each BRAC round. 

To provide optimal control, BRAC appropriations are provided in five year accounts 
and thus need not be obligated in the year of appropriation. Additionally, with the exception 
of the environmental subaccount prior to FY96, BCA monies need not be used in the 
subaccount for which they were requested. Prior to FY96, legislation established a floor for 
the environmental subaccount requiring DoD to spend no less than the appropriated amount. 
Consequently, the minimum environmental subaccount amount could not be reallocated to 
other subaccounts. However, starting in FY96 the Defense Appropriations Act established 
an environmental subaccount ceiling above which DoD is prohibited from spending unless it 
notifies Congress. The ceiling provision now allows environmental funds to be shifted among 
all subaccounts. [Ref. 32] 

The BRAC environmental subaccount funding profile shown in Figure 3-4 on the 
following page reflects BCA funding allocations, by BRAC round, for FY91 through FY96 
and budgeted funding for FY97 through FY99. In addition to notional BRAC environmental 
restoration costs, the BCA environmental subaccount provides funds for closure-related 
environmental compliance and environmental planning. As is the case with DERA funds, 
BCA environmental appropriations are executed by NAVFACENGCOM under the DERP. 
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BRAC ENVIRONMENTAL FUNDING PROFILE 



Figure 3-4. DoD BRAC Environmental Funding Profile (FY91-FY99) 


D. DON ENVIRONMENTAL FUNDING 

Since 1984, roughly $2.5 billion in DERA funding was spent identifying, assessing, 
and cleaning up past hazardous waste disposal sites at Navy and Marine Corps installations. 
During the early years, DoN spent an ample amount of this DERA funding on investigations 
to locate sites and characterize the nature and extent of contamination. The increased 
emphasis on cleanup actions has resulted in a significant shift in resource allocation in the past 
several years. For example, DoN spent only 14% of its DERA portion on cleanup in FY92. 
In FY96, the cleanup category of the DERP accounted for 64% of DoN’s DERA funds. To 
incentivize further cleanup progress, the FY96 Defense Authorization Act established a goal 
requiring 80% of program funding to be used for actual cleanup beginning in FY98, [Ref. 33] 
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BRAC funds, in the form of the BCA environmental subaccount, have been executed 
by DoN to fulfill restoration requirements for the 1,035 total DoN BRAC sites as of the end 
of FY96. Cleanup progress at the DoN sites has increased nearly six-fold since FY94. DoN’s 
share of DoD’s BRAC environmental subaccount, both in actual dollar amounts and as a 
percentage of the subaccount total, is shown in Figure 3-5 below. 

The inter-year fluctuations highlight the focus of the BRAC restoration program on 
achieving prescribed remediation timelines. For instance, the abrupt decline in Navy funding 
percentage in FY96 can be attributed to the abrupt increase in Army funding largely due to 
the looming finish to the BRAC I closure timeline in which the Army was most severely 
impacted. In contrast, the forecasted DoN funding percentages for FY97 and beyond are 
notably increased to address the timeline restrictions for BRAC III in which the Navy was 
most severely impacted. 


BRAC ENVIRONMENTAL FUNDING by COMPONENT 



Figure 3-5. DoD BRAC Environmental Funding by Component 
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E. 


SUMMARY 


The funding legacy of the Department of Defense’s (DoD) Defense Environmental 
Restoration Program (DERP) provides unequivocal evidence of the expanding importance 
our nation places on environmental safety and public health. To fund DoD’s environmental 
restoration efforts in this regard, Congress provides funds in two separate accounts; The 
Defense Environmental Restoration Account (DERA); and the environmental subaccount of 
the Base Closure Account (BCA). The DERA primarily incorporates operating installations 
while the BCA subaccount incorporates closing and realigning installations. Although their 
utilization is strictly segregated by statute, the two accounts are organizationally linked. In 
fact, all of the DoN BRAC installations utilized in the forecasting model formulation of this 
thesis consumed DERA funds prior to being placed on their respective BRAC lists. 

In terms of both active and closing installations, DoD has experienced a marked 
expansion in its environmental enterprise this decade to confront rapid contaminated site 
growth, elaborate regulatory mandates, and increased remediation tasks. In addition, DoD’s 
emphasis on cleanup activities has resulted in a pronounced rise in both the number of true 
remediation actions and the expenditures associated with this more elaborate endeavor. The 
cleanup initiative seeks to conclude restoration in accordance with statutory requirements via 
a site relative risk reduction prioritization of cleanup and investigation operations. 

The BCA furnishes the greatest flexibility in meeting unique and stringent regulatory 
and requirements timeline restrictions for BRAC facilities. Funding for DoD’s BRAC 
environmental restoration comes from one of six BCA subaccounts appropriated by Congress. 
The BCA environmental subaccount is executed by NAVFACENGCOM under the DERP 


37 


in similar fashion to DERA appropriations. The BCA funds are provided in flexible five year 
accounts and the subaccounts are not fenced. There is, however, a statutory ceiling for the 
BCA’s environmental subaccount to limit expenditures for restoration. 

In the last 12 years, nearly $4 billion in environmental restoration funding (DERA and 
BCA) was spent identifying, assessing, and cleaning up past hazardous waste disposal sites 
at both active and BRAC Navy and Marine Corps installations. A significant segment of the 
early DoN DERA funding, especially in the investigation category, was expensed on sites at 
installations subsequently affected by the four rounds of BRAC. The BRAC funds, in the 
form of the BCA environmental subaccount, have been expended by DoN to exclusively fulfill 
the environmental requirements for the 1,035 sites on Navy controlled property. The bulk 
of recent DoN BCA environmental funds has supported the cleanup category of the 
restoration program, increasing expenditures in cleanup phases by roughly six times in the last 
few years. DoN’s ability to concentrate BRAC environmental monies on genuine remediation 
is due in large part to both DoD’s “cleanup versus investigation” initiative and the previous 
expenditures of DERA funds on the site investigation phases. 
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IV. DATA DESCRIPTION AND FORECAST MODEL FORMULATION 


A. INTRODUCTION 

The primary thesis objective is the development of a comprehensive and serviceable 
forecasting model for estimating environmental restoration costs at Department of the Navy 
(DoN) Base Realignment and Closure (BRAC) facilities. The model detailed in this chapter 
is constructed via historical data, incorporating a set of quantitative and qualitative installation 
parameters to determine significant restoration cost drivers and estimate future expenditures. 

The remainder of the chapter is divided into five sections. Section B describes the 
collection and employment of the installation restoration data utilized in model formulation. 
Section C introduces the regression analysis, presenting the essential basics of causative 
model forecasting needed to interpret and analyze regression results. Section D explains the 
adopted regression model methodology. Section E presents a review and interpretation of 
the generated forecasting model outcomes. Section F summarizes the chapter highlights. 

B. DATA COLLECTION AND DESCRIPTION 

Research data collection encompassed environmental restoration cost data and a 
myriad of installation parameters for DoN BRAC facilities for the period of FY89 through 
FY96. The compiled data were configured to build the most viable mathematical cost 
forecasting model given the available data. Recent data for FY94 through FY96 proved to 
be the most valuable in model formulation due to the precipitous increase in the quality and 
quantity of available installation information during these years. The facilities employed in 
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model formulation were further pared to major DoN BRAC facilities having anticipated future 
cumulative restoration expenditures exceeding one million dollars in each year (FY94-FY96) 
being studied. The fiscal restriction is necessary due to the limited amount of comprehensive 
data available once an installation falls below the million dollar future expenditure threshold. 
In addition, the later timing of BRAC IV precluded those facilities from model inclusion. 
However, the BRAC IV facilities were used to test model validity as illustrated in Chapter VI. 

For purposes of forecast model development, a total of 17 DoN facilities met all the 
selective data conditions. Extensive parametric data were compiled for each of the 17 
facilities over the FY94-FY96 period, yielding a total of 51 autonomous data points. Each 
installation data point entails multiple explanatory variables with which to build the regression 
model. The installations employed in model formulation are listed in Table 4-1 below. 


INSTALLATION 

INSTALLATION 

Agana Naval Air Station 

Mare Island Naval Shipyard 

Alameda Naval Air Station 

Moffett Field Naval Air Station 

Barbers Point Naval Air Station 

Orlando Naval Training Center 

Cecil Field Naval Air Station 

San Diego Naval Training Center 

Davisville Naval Construction Battalion Center 

Treasure Island Naval Station 

El Toro Marine Corps Air Station 

Trenton Naval Air Warfare Center 

Glenview Naval Air Station 

Tustin Marine Corps Air Station 

Hunters Point Annex Naval Station 

Warminster Naval Air Warfare Center 

Long Beach Naval Station 



Table 4-1. DoN BRAC Installations Employed in Regression Model Formulation 
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After establishing the viable installations to be utilized in forecast model formulation, 
an exhaustive collection of dependent and explanatory variable candidates was compiled. The 
choice of the dependent variable candidates was self-evident given the central thesis focus of 
forecasting environmental restoration expenditures. The dependent candidates quite naturally 
included the available installation restoration cost data. Data for the dependent variables were 
derived primarily from the DERP’s Annual Reports to Congress for FY94 through FY96 and 
installation information provided by NAVFACENGCOM via their Site Base Cleanup Plan 
internet web pages [Ref 34], Specifically, each dependent variable shown in Table 4-2 below 
was applied in numerous regression analyses to determine the most functional choice. 


Symbol Dependent Variables 

SIC Total Cumulative Investigation Category Cost 
see Total Cumulative Cleanup Category Cost 

$TC Total Cumulative Restoration Cost (“Investigation” plus “Cleanup”) 


Table 4-2. Dependent Restoration Cost Variables 


The collection of explanatory variable candidates is expectedly much more extensive 
than that of the dependent candidates. Inasmuch as the selection of the dependent regression 
variable is readily apparent, the selection of explanatory variables - especially in empirical 
research - is far less evident. The explanatory variables amassed for model formulation 
included 25 individual parameters for each installation. These variables are categorized in two 
broad divisions - quantitative and qualitative - based on their data properties. 
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Quantitative variables are the most familiar parameter type, consisting simply of data 
available in a quantitative cardinal number format. In contrast, qualitative variables account 
for relevant categorical data qualities not conventionally measured on a numerical scale. To 
construct a factual and meaningful estimating model, the regression analysis must account for 
the influential qualitative explanatory variables that cannot be readily quantified. In regression 
modeling, the categorical (or “dummy”) variable is used to capture the substance of these 
qualitative explanatory variables. Categorical variables indicate the condition or state of the 
non-quantifiable data, taking on a value of either 0 or 1, depending on the existence of its 
explanatory status. Table 4-3 on the following page itemizes the domain of installation 
explanatory variables initially implemented in model formulation. 

A general criterion for selecting explanatory variables for regression analysis is that 
the causal relationship between the dependent and explanatory variable makes intuitive sense 
to both the analyst and the end user. Once the causality condition is satisfied and a given set 
of explanatory variables is assembled, the formidable task of uncovering the most statistically 
relevant variables must be addressed. Through continual calculational regression iterations 
and statistical significance analysis employing numerous combinations of data variables, the 
optimal blend of explanatory variables can be determined. It is important to recognize that 
regression analysis is not designed to identify explanatory variables that have been omitted 
from the model, but rather to determine the statistical significance of the variables present. 
In this regard, an exhaustive collection of data variables such as shown in Table 4-3 is a 
judicious choice for initial model generation. 
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QUANTITATIVE 


QUALITATIVE 


Variable* 

Symbol 

Variable 

Symbol 

Total Number of Sites 

Sts(T) 

Installation NPL Status 

NPL 

Sites w/ Study Phase Complete 

Sts(S)-c 

Installation FFA/IAG Status 

FFA 

Sites w/ Study Phase Underway 

Sts(S)-u 

Installation EBS status 

EBS 

Number of IRAs Complete 

Sts(A)-c 

Installation Location (State) 

CA? 

Number of IRAs Underway 

Sts(A)-u 

Installation Type 

TYPE 

Sites w/ Design Phase Complete 

Sts(D)-c 

Re-Use Plan Status 

RAJ 

Sites w/ Design Phase Underway 

Sts(D)-u 

Operational Status 

OP? 

Sites w/ Cleanup Phase Complete 

Sts(C)-c 



Sites w/ Cleanup Phase Underway 

Sts(C)-u 



Sites with Response Complete 

Sts(RC) 



Installation Acreage 

InstA 



Excess Acreage 

ExcA 



Unsuitable Acreage 

UnstA 



% Unsuitable Acreage 

%Unst 



Estimated Years-to-Completion 

YTC 



Years Restoration Costs Incurred 

YRCI 



**Sites w/ Relative Risk - High 

Sts(H) 



**Sites w/ Relative Risk - Medium 

Sts(M) 



(*): Data are “per installation” 

(**): Data for FY95-FY96 only 





Table 4-3. List of Explanatory Variables Employed in Regression Modeling 


43 











The selection of quantitative and qualitative explanatory variables was a function of 
both the availability of employable data and the ability to mathematically translate the real- 
world factors that drive environmental restoration costs. As previously mentioned, the choice 
of the quantitative variables was relatively straightforward, primarily driven by the data 
available from the DERP and NAVFACENGCOM. In addition to the strict employment of 
raw quantitative values, data manipulation of the quantitative variables included the logical 
mathematical combination of parameters to yield additional explanatory values. For example, 
the variable “% Unsuitable Acreage” (%Unst) was derived by subtracting the available raw 
values of “Suitable Acreage” from “Excess Acreage” divided by “Excess Acreage”. 

In contrast to quantitative variable selection, the designation of qualitative variables 
was less obvious and more subjective in nature. In general, the choice of qualitative variables 
originated principally from literature research on the determinant events in the environmental 
restoration process and from consultations with NAVFACENGCOM personnel familiar with 
the drivers of restoration activities and the flow of funding. A brief bulletized description of 
each of the qualitative explanatory variables employed in forecast model formulation are 
outlined below. 

• Installation NPL Status (NPL) . The very nature of an installation’s inclusion on 
the NPL demands increased restoration effort prioritization. Additionally, it is 
postulated that once an NPL installation has been placed on a BRAC list, 
restoration efforts would receive even higher prioritization to mitigate the stigma 
associated with a Superfund site and thus, enable prompt property transfer/re-use. 

• Re-Use Plan Status (RAJI . Re-Use plan generation involves many groups, most 
notably community development officials. According to DoN restoration 
personnel, a BRAC facility with a well developed R/U plan is more inclined to 
receive higher priority in both restoration activity and resource allocation in order 
to maximize the benefits of the BRAC process by expediting land turnover. 
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• Installation FFA/IAG Status (FFAV A Federal Facilities Agreement (FFA) 
specifies the roles and responsibilities of the regulatory agencies and DoD, as well 
as, establishing milestones for future cleanup actions. Early involvement of 
regulatory agencies via FFAs ensures concurrence and enhances credibility of DoD 
actions. DoD seeks this cooperative and collaborative effort to avoid 
complications late in the process that could result in costly delays and rework. 

• Installation EBS Status (EBSV The Environmental Baseline Survey (EBS) is the 
DoD process utilized to evaluate and identify a parcel’s environmental condition. 
The EBS defines seven Area Types for categorizing of property. It is this 
characterization that serves as the conclusive property status document required 
for government real estate transactions under the Findings of Suitability to Lease 
(FOSL) and Findings of Suitability to Transfer (FOST) programs. 

• Installation Location (CA?) . Due to the growing conduct of coordinated 
restoration efforts with Federal, state, and local authorities, non-DoD regulators 
tend to dominate restoration requirements. Generally, the localities with relatively 
stricter regulatory mandates demand more extensive restoration effort. In this 
regard, literature research and discussions with federal restoration personnel 
invariably highlight the state of California as being distinctly stringent on 
environmental restoration requirements. 

• Installation Type (TYPE) . Intuitively, the character of past operations, engendered 
in the type of installation, greatly shapes the amount and type of restoration effort. 
Restoration research and counsel with NAVFACENGCOM personnel point 
toward Naval Air Stations (NAS) as the most environmentally challenging cleanup 
endeavors. The best explanation for this phenomenon may be both the relatively 
statistically larger size (acreage) of NAS’s and the unique type of aviation 
contaminants, driving costly remediation for soil and groundwater contamination. 

• Operational Status fOP?) . This variable was conceived in order to unveil whether 
operational status affects the rate and/or timing of environmental restoration 
resource consumption. The presumption was that facilities that are no longer 
operating are able to focus more exclusively on restoration activities. Additionally, 
the tracking of operating status serves as a surrogate measure for advance along 
the BRAC time line. 

The actual regression model process and statistical results are detailed in Sections D 
and E of this chapter. Additionally, a comprehensive breakdown of each DoN BRAC facility 
and its corresponding dependent and explanatory variable data is given in Appendix A. 
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An interrelated primary objective of thesis research is the derivation and quantification 
of the measurable effects of a BRAC initiation on a facility’s key parameters. In establishing 
these BRAC initiation effects on installation parameters, all available data for DoN BRAC 
facilities, including the earlier years of FY89-FY93, were incorporated without restriction. 
A listing of those facilities and the parametric variables measured is detailed in Chapter V. 

C. FORECASTING MODEL FORMULATION 

The application of mathematical and statistical methods to analyze and forecast 
economic measurements is commonly referred to as Econometrics [Ref 35]. In this regard, 
the econometric method of multiple regression is one of the most popular and versatile 
estimating procedures in the analysis of non-experimental economic data [Ref 36]. 
Specifically, multiple regression is a technique for quantifying relationships and causality 
among multiple variables. Multiple regression is concerned with quantitatively describing and 
predicting the value of one dependent variable on its interaction with several explanatory or, 
independent, variables. 

Regression analysis is a statistical instrument applied to develop a mathematical 
relationship between econometric variables and to determine the statistical significance of the 
variables under analysis. The multiple regression output is an algebraic model depicting an 
equation for the expected value for the dependent variable given specific values for the 
explanatory variables. The general form of the regression equation is given below. 

Y = a + bi*X, + b2*X2 + bj^Xj +. 
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In this standard regression equation, the Y term represents the dependent variable, the 
a term is the linear intercept or “constant”; the X terms represent the explanatory variables; 
and the b terms are the coefficients of partial regression. The b terms are interpreted as the 
average change in the dependent variable (Y) with a unit change in the adjoining explanatory 
variable (X), assuming all other explanatory variables remain constant. The derived constant 
values for the a and b terms are utilized in the equation for various combinations of 
explanatoiy X variables to predict a quantitative value for the dependent Y variable. 

When evaluating the statistical results of a multiple regression calculation, there are 
four central measures of goodness of fit that determine the significance and accuracy of the 
regression output. The four goodness of fit measures - Standard Error of Estimate (S); t- 
ratio; F-statistic; and the Coefficient of Determination (R-Sq) - are briefly profiled below. 

• Standard Error of Estimate (S) . The Standard Error measures the vertical distance 
from the sample data points to the computed regression line thus enabling 
examination of the data dispersion about the estimating equation. The value of the 
Standard Error is akin to the value of standard deviation in a normal distribution. 
For ascertaining goodness of fit, a smaller Standard Error value is considered 
superior to a higher value. 

• The t-ratio . The t-ratio demarcates statistical significance for explanatory variable 
coefficients of the regression line. The resultant individual explanatory variable t- 
ratios must meet or exceed a statistical critical value to be considered significant. 
For a 95% confidence level, a variable’s t-ratio must be greater than or equal to an 
absolute value of roughly 2.0 to merit further model inclusion. Generally, the 
higher the t-ratio is above 2.0, the more statistically significant the explanatory 
variable. 

• The F-ratio . The F-statistic tests the sufficiency of the regression model as a whole 
by measuring how robustly the entire selected combination of explanatory variables 
characterize the system being analyzed. If the computed F-ratio is less than the 
statistical critical value (roughly 4.0 for a 95% confidence level), then the selected 
combination of explanatory variables does not reliably capture the system under 
test. A higher F-statistic suggests a more statistically significant regression model. 
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• CoeflScient of Determination (R-SqV The Coefficient of Determination measures 
the percent variability of the dependent variable that can be explained by the 
regressed combination of explanatory variables. Values for R-Sq range from 0.0% 
to 100%, with a higher percentage denoting a model with greater explanatory 
power. Even though the statistical significance of R-Sq is assessed using the F- 
ratio, the analyst must rationally conclude an acceptable numerical R-Sq threshold 
above which definitive conclusions can be drawn. 


The multiple regression forecasting process conducted on the accumulated data is 
detailed in Sections D and E that follow. The forecast model designs, resultant mathematical 
equations, and statistical results are to be interpreted utilizing the terms discussed above. 


D. FORECASTEVG MODEL METHODOLOGY 

In creating a realistic and reliable forecast model, the explicit objective is to construct 
a multiple regression model relating environmental restoration costs to several decisive 
explanatory variables. Since there is no certifiable link between environmental restoration 
costs and any exclusive set of installation variables, the regression model approach must 
necessarily be an empirical endeavor. To assure complete and conclusive results, an 
exhaustive set of explanatory variable candidates likely to influence environmental restoration 
costs was assembled to systematically construct the forecast model and to test its adequacy 
of fit. 

Prior to executing any of the countless regression runs, the data distribution for each 
of the dependent variables was examined to determine its geometry. In order to maximize the 
precision of multiple regression, the dependent variable must be nearly symmetric in 
distribution since confidence intervals and tests of statistical significance are based on the 
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assumption that the dependent variable is normally distributed For each of the study’s 
dependent cost variables, the histogram profiles exhibited an asymmetric distribution. To 
correct such a phenomenon, common practice is to adjust empirical data using mathematical 
transformations in order to provide a more symmetric distribution. Specifically in the case 
of the restoration cost variables, a logarithmic (“logt”) transformation proved the most 
effective adjustment to each of the data distributions. A particular example of the dependent 
variable data transformation effects is illustrated in Appendix B. 

At the outset, the model formulation strategy consisted of regressing each of the 
dependent variable candidates - Total Cost ($TC); Investigation Cost (SIC); and Cleanup 
Cost ($CC) - on all the explanatory variable candidates. This total variable inclusion 
approach was adopted primarily to ensure no fundamental causal variables were omitted from 
the model. As a statistical mechanism, the method permitted examination of the individual 
partial regression coeflBcients in order to make preliminary judgements about the importance 
of each explanatory variable. The initial models also served as the basis for statistical 
comparison to all successive regression revisions. 

From the all-encompassing initial regression models, systematic statistical reduction 
continued, one explanatoiy variable at a time, until all remaining variables were statistically 
significant (i.e., each partial regression coefficient t-ratio absolute value is greater than the 
critical values necessary for significance at the 95% confidence level). Parallel to the t-ratio 
analysis, each successive regression was evaluated on its performance in improving overall 
model significance. This assessment was accomplished by comparing F-statistics, Coefficients 
of Determination (R-Sq), and Standard Error of Estimates (S) in each ensuing regression run. 
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In addition to the goodness-of-fit measures explained in Section C above, several 
auxiliary tests were conducted to confirm the validity of the regressed solution. The 
additional tests assist in verifying the maintenance of critical regression model assumptions. 
The specific verifications attempted in regression formulation include tests for: linearity and 
homoscedasity (Residual versus Fit plots); the normality of error distribution (Normal 
Probability plot); autocorrelation (Durbin-Watson Test); experimental lack of fit (XLOF test); 
and explanatory variable correlation (CORK test). The actual numerical and graphical results 
for the model validation tests conducted in the final regression are provided in Appendix B. 

All of the multiple regression computations and analytical tests were performed using 
the commercially produced MINITAB Statistical Analysis software package. The data and 
graphical representations in Appendix B are outputs of the MINITAB system. Brief 
explanations accompany some of the data and graphics in Appendix B to help clarify the 
relevance of the presentations. 

E. FORECASTING MODEL RESULTS AND ANALYSIS 

Each dependent variable underwent the comprehensive regression model formulation 
process to ensure all plausible combinations of installation data were incorporated. Table 4-4 
on the following page summarizes the multiple regression outcomes for the best combination 
of explanatory variables for each of the dependent variables. The regression results for each 
dependent variable are further clarified in the subsections that follow. 
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Denendent Variable 

F-statistic 

R-Sq 

S 

logt ($TC) 

18.57 

75.1% 

0.2143 

1 logt (SIC) 

12.86 

67.7% 

0.2591 

logt ($CC) 

9.47 

46.8% 

0.6552 


Table 4-4. Final Regression Results for FY94-96 Data on Each Dependent Variable 


1. Total Cost ($TC) Regression 

Evident from the statistics in Table 4-4 above, the regression method employing the 
dependent variable of Total Cumulative Environmental Restoration Cost (Total Cost ($TC)) 
resulted in the most significant forecasting model. Interpretation of the resultant regression 
outputs show that the model utilizing transformed Total Cost ($TC) features the most 
preferred result combination of highest F-Statistic, highest R-Sq, and lowest Standard Error 
of Estimate (S). Deserving of particular mention is the surprisingly substantial value for the 
Coefficient of Determination (R-Sq) given the purely empirical nature of the regression data. 
An R-Sq value of 75.1% implies that 75% of the variation in Total Cost ($TC) is captured 
and explained by the assembled dependent variables. Chapter VI will fully reveal the entire 
$TC resultant regression equation and describe a spreadsheet implementation method. 

Of the 25 explanatory candidates included in the initial Total Restoration Cost ($TC) 
regression model runs, only seven installation variables proved statistically significant for 
forecasting purposes. The final set of seven explanatory variables contained three quantitative 
and four qualitative variables. Table 4-5 on the following page lists the regression statistics 
and briefly restates the descriptions for each of the seven explanatory variables. Due to the 


51 










necessary transformation of the dependent variable in regression model formulation, the 
interpretation of the stated variable coefficients (Coeff) must be considered with respect to 
the non-linear nature of the regression. Chapter VI details the linear conversion of the data 
to yield results in terms of standardized installation parametric values. 


VAR 

t-ratio 

Coeff 

Explanatory Variable Description 

Sts(T) 

4.88 

0.01417 

Total Number of Sites on Installation 

UnstA 

3.90 

0.00012 

Unsuitable Acreage - (Excess Acreage minus Suitable Acreage) 

Sts(C) 

2.42 

0.03877 

Sum of Sites w/ Cleanup Phase Complete or Underway 

CA? 

4.31 

0.31660 

Installation Location (State) - (variable=l if state was California) 

RAJ 

4.10 

0,26135 

Re-Use Plan Status - (variable=l if definite RAJ plan during FY) 

FFA 

-4.05 

- 0.4597 

Installation FFA/IAG Status - (variable=l if agreement during FY) 

NPL 

3.56 

0.42930 

Installation NPL Status - (variable=l if on NPL during FY) 


Table 4-5. Resultant Significant Forecasting Model Explanatory Variables for $TC 


2. Investigation Cost ($1C) Regression 

The equally significant results from the regression on Total Cumulative Investigation 
Cost (SIC) suggest a meaningful correlation between Investigation and Total Restoration 
Cost. This cost association has its roots in actual restoration practices. Despite the recent 
crossover of cleanup activities versus investigative actions, the predominant driver of Total 
Cumulative Restoration Cost to-date is in the Investigation Cost category. In fact, for the 
cost data compiled in this study. Investigation Cost constituted nearly 80% of Total Cost. 
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3. 


Cleanup Cost ($CC) Regression 


In contrast to the clear correlation between Investigation Cost and Total Costs, the 
best possible regression on Total Cumulative Cleanup Cost produced markedly less significant 
results. Aside from the explanation that cleanup category actions have lagged investigative 
actions, the lower Cleanup Cost regression results suggest important inferences about the 
usability of empirical parametric cleanup activity data. In fact, what may seem intuitively 
obvious is confirmed by the results of these comparative regressions. That is, cleanup 
activities are far more complex and variable than other restoration activities and thus the 
analysis of historical parametric data for Cleanup Cost is less likely to predict future cleanup- 
specific activity costs. In other words, most of the unexplained variance in environmental 
restoration cost forecasting can be attributed to the mercurial nature of cleanup activities and 
the lack of substantial historical data on full-completion cleanup actions. 

4. Comparing Regression Results 

Further comparison of the regression results for each of the three different dependent 
variables highlighted the common cost drivers in every model. Four explanatory variables - 
Total Sites (Sts(T)); Sites with Cleanup Phase work complete or underway (Sts(C)); 
Installation NPL Status (NPL)); and Status of Re-Use plan (R/U)) - were significant factors 
in each dependent variable regression, suggesting that these four installation parameters are 
the most universally applicable cost drivers for any type of environmental restoration cost 
being studied or estimated. 
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In comparing the less volatile Investigation Cost and Total Cost regressions, all seven 
explanatory variables listed previously in Table 4-5 were statistically significant in both cases. 
Of note, the Installation Type (TYPE) explanatory variable was only slightly below the 
statistical critical value in both the Total Cost and Investigation Cost regressions. Table 4-6 
below summarizes the relevant explanatory variables that are statistically significant in each 
dependent variable regression. 


Explanatory Variables 

$TC 

SIC 

see 

Sts(T) 

X 

X 

X 

UnstA 

X 

X 


Sts(C) 

X 

X 

X 

R/U 

X 

X 

X 

CA? 

X 

X 


1 

FFA 

X 

X 


NPL 

X 

X 

X 


Table 4-6. Summary of Statistically Significant Explanatory Variables 


5. Incorporating Relative Risk 

In an attempt to facilitate inclusion of Relative Risk Site Evaluation parameters, 
additional regressions were performed on each dependent cost variable. DoD’s Relative Risk 
Site Evaluation framework is intended to adjust environmental restoration goals based on a 
site prioritization basis. Reduced funding levels command DoD to more effectively direct its 
limited resources to sites that pose the greatest threat to human health and the environment. 
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The Relative Risk strategy assigns each potentially contaminated site to a high, medium, or 
low risk category. In determining the categorization, the Relative Risk procedure addresses 
several site characteristics, including: specific contaminants present; the significance of 
contamination; contaminant migration pathways; and human and ecological receptors located 
near the site. 

Due to the recent implementation of the Relative Risk program, the regressions 
including Relative Risk data utilized only FY95 and FY96 data. Employing the identical 
formulation process used to build the more inclusive FY94-FY96 model, each dependent 
variable underwent a similar comprehensive regression procedure to ensure all plausible 
combinations of installation data were incorporated. Each regression’s statistical results for 
FY95-96 data were encouragingly similar to the results of the full data (FY94-FY96) 
regression statistical outcomes. As in the full data regressions, the most statistically 
significant results proved to be the regressions on Total Cost ($TC). The multiple regression 
outcomes for the FY95-FY96 data runs are summarized in Table 4-7 below. 


Dependent Variable 

F-statistic 

R-Sq 

S 

logt ($TC) 

14.78 

76.7% 

0.1916 

logt (SIC) 

10.97 

52.3% 

0.2874 

logt (SCC) 

8.38 

47.3% 

0.5330 


Table 4-7. Final Regression Results for FY95-96 Data on Each Dependent Variable 


55 









Although the FY95-FY96 regression results go a long way in supporting the 
robustness of the full FY94-FY96 data regression model, an additional major research finding 
is the real success of the FY95-FY96 data test. In each of the regressions on the dependent 
variables, all of the models produced results devoid of the high priority Relative Risk 
parameters - High Priority Sites (Sts(H)) and Medium Priority Sites (Sts(M)) - as statistically 
significant explanatory variables. In fact, the Relative Risk data were not even marginally 
significant in any of the iterative regressions. 

The statistical insignificance of the Relative Risk data in forecast model formulation 
may be interpreted in two general ways: 

• The cost effects of the Relative Risk measures are already captured by some of the 
variables resident in the developed forecast model and thus, the Relative Risk 
measures become redundant and insignificant variables. 

• The Relative Risk program may not be properly constructed due to being an a 
priori measure based on supposition rather than an empirically based measure. 

When analyzing the Relative Risk program and the developed forecast model it seems 
that Relative Risk characterization procedures (described previously) include assessments on 
installation parameters not captured by the developed forecast model variables. As a result, 
the second interpretation of Relative Risk insignificance (see above) appears more accurate. 
However, with the recent (FY95) implementation of Relative Risk Site Evaluation, the use 
of only the first two years of program data may not be indicative of the future significance 
Relative Risk plays in driving environmental restoration costs. Further research should focus 
on the Relative Risk Site Evaluation initiative to ensure it is meeting its intended purpose. 
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F. 


SUMMARY 


To achieve the primary thesis objective of constructing a comprehensive, inclusive, 
and functional environmental restoration cost forecasting model, substantial amounts of 
installation parameters required rigorous data management and anlysis. To this end, over 25 
separate installation statistical parameters were compiled for each of the qualifying 17 DoN 
BRAC facilities over the most recently available three year period (FY94-FY96). A multiple 
regression technique was employed to manage the extensive data and construct the forecast 
model. Multiple regression is a multifaceted estimating method, quantifying relationships and 
causality among multiple variables in the analysis of empirical data. 

The most tenable and statistically significant forecast model was the regression of the 
transformed dependent variable of Total Cost ($TC). By an iterative regression process, a 
final combination of seven explanatory installation variables (highlighted in Table 4-5) proved 
to be the most meaningful restoration cost drivers. The developed $TC regression model 
resulted in an R-Sq statistical value of 75.1%, implying that 75% of the variation in Total 
Cost ($TC) is captured and explained by the assembled dependent variables. 

Comparison of the regression results for each of the three different dependent 
variables reveals the common cost drivers in every model. Four explanatory variables - Total 
Sites (Sts(T)); Sites with Cleanup Phase work complete or underway (Sts(C)); Installation 
NPL Status (NPL)); and Status of Re-Use plan (R/U)) - were significant factors in each 
dependent variable regression, suggesting that these four installation parameters are the most 
universally applicable cost drivers for any type of environmental restoration cost being studied 
or estimated. 
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What is equally as important, and no less interesting, is the explanatory installation 
variables that proved statistically insignificant in explaining the dependent variable cost 
variations. The most striking of the non-significant explanatory variables, as detailed in the 
section above, include the Relative Risk Site Evaluation program data. 
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V. EFFECTS OF BASE REALIGNMENT & CLOSURE INITIATION 


A. INTRODUCTION 

The effects of a Base Realignment and Closure (BRAC) action on an installation are 
multifarious and far-reaching. All facets of the affected facility, from daily operations and 
manning to environmental parameters, are thrust into a state of dynamic transformation. The 
scope of change at a facility is never uniform or consistent in its timing. Of particular thesis 
research interest are the magnitude and timing of changes to environmental restoration 
parameters as a result of BRAC initiation. It is postulated that the initiation of a base closure 
or realignment action rapidly accelerates a facility’s environmental restoration timetable and 
thus begets a discernible increase in expenditure rate and resource consumption. 

The aim of this chapter is to fulfill the second primary thesis objective of determining 
the key installation parameters that appear sensitive to the initiation of BRAC. In attempting 
this quantification of parametric change, the full range of available parametric data (FY89- 
FY96) was employed on a full range of DoN BRAC facilities. As mentioned in Chapter III, 
a preponderance of DoN facilities had some level of environmental restoration data available 
through the DERP prior to being placed on a BRAC list. Specifically, the data compiled 
consisted of environmental restoration parameters for all major and minor DoN closures and 
realignments for BRACs I through IV. The data were analyzed to determine: 

• General effects experienced by installation parameters after BRAC initiation 

• The timing of the noticeable parametric effects 

• Effects related uniquely to the type of BRAC action (i.e., closure vs. realignment) 
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The remainder of this chapter is divided into five sections. Section B briefly outlines 
the established regulatory BRAC timelines that ostensibly influence environmental restoration 
activities. Section C describes the pool of installation data utilized to establish empirical 
BRAC parameter effects. Section D details the results of data comparison on the historical 
parameter changes experienced by facilities following the inception of base closure or 
realignment proceedings. Section E provides a chapter summary, highlighting the empirically 
determined BRAC parameter delta “rules of thumb” to be considered in the forecasting of 
environmental restoration expenditures. 

B. INFLUENCE OF BRAC TIMELINES ON RESTORATION ACTIONS 

Of considerable consequence to the implementation of BRAC proceedings are the 
legal and regulatory requirements governing the timing of BRAC environmental restoration 
operations. In order to accurately examine the effects of BRAC initiation on a facility’s 
environmental parameters, it is crucial to understand the sequence of events and the time 
period in which those events occur. Generally speaking, there is a discernible lag between the 
enactment of a BRAC list and the subsequent BRAC-related environmental restoration 
activities performed at a newly affected installation. A notional BRAC timeline is portrayed 
in Table 5-1 on the following page to underscore the occurrences of environmental 
restoration actions as sequenced to the official BRAC recommendation date of approval. 
Timeline structuring was gleaned from the Department of the Air Force Base Closure 
Agency’s Base Closure Timeline Fact Sheet [Ref 38]. 
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Month, FY 

Resulatory Requirement 

Resulatorv Descriotion 

SEP,XX 

BRAC XX List Approval 

Expiration of Congressional Disapproval 
Authority (45 days after submission) 

OCT,XX+l 

DoD Notice of Availability of 
Property to Federal Agencies 

Federal Agencies and other military 
services have initial access to property 

DEC,XX+1 

Federal Agency applications 
submitted for property transfer 

Within 60 days of availability notice 

JAN,XX+1 

DoD publishes excess/surplus 
property listings 

Within 100 days of availability notice 

MAR,XX+1 

DoD holds community Re-Use 
and Redevelopment seminars 

6 months after BRAC list approval date 

JUN,XX+1 

Time period for submission of 
property notices of interest 

Within 6 months of publishing excess/ 
surplus property in Federal Register 

MAR,XX+2 

DoD completes identification 
of uncontaminated parcels 

18 months after BRAC list approval 
(CERCLA mandated) 

MAR,XX+2 

Community Re-Use and Re¬ 
development plans due to DoD 

Within 9 months after completion of 
submitted property notices of interest 

AUG,XX+2 

DoD officially initiates BRAC 
activities 

Within 2 years after Presidential 
approval of BRAC list 

MAR,XX+3 

DoD completes Environmental 
Impact Statement (EIS) 

12 months after community Re-Use and 
Redevelopment plan submittals 

AUG,XX+6 

DoD officially completes 

BRAC activities 

Within 6 years after Presidential 
approval of BRAC list 


Table 5-1. Notional BRAC Timeline for Environmental Restoration Activities 
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It becomes clear after examination of Table 5-1, that the critical environmental 
restoration events of determining excess/surplus property, establishing Re-Use committees, 
identifying uncontaminated parcels, officially initiating BRAC actions, and completing 
Environmental Impact Studies, occur some time after the BRAC list has assumed force of 
law. As will be detailed in Section D of this chapter, the accompanying restoration actions 
of the later occurring environmental milestones translate to a lagged effect on parameter 
changes and restoration expenditures. By way of example, the initiation of BRAC IV in 
September of 1995 (FY95) did not result in explicit BRAC-related installation parametric 
effects and related expenditures in some instances until FY97, and a majority of the 
remediation may not be concluded until as late as FYOl. 

To fully capture the consequences of BRAC initiation and thus facilitate reliable 
forecasting, the timing and disposition of BRAC environmental actions must be coupled with 
the changing parametric effects. Understanding when and over what period to apply 
projected changes in installation parameters is vital to the credibility of the predictive strength 
of the forecasting method. 


C. DATA DESCRIPTION FOR BRAC-RELATED PARAMETRIC EFFECTS 

In an attempt to establish and quantify the effects of BRAC initiation on a facility’s 
environmental parameters, the full range of available parametric data was employed on a full 
range of DoN BRAC facilities. The analysis of parametric change encompassed the available 
installation data for FY89 through FY96. Table 5-2 on the following page lists the 42 DoN 
installations utilized for this effort. To be included in this focus group, each facility was 
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required to have data available in each of the years under study. Due to the less sophisticated 
and less restrictive nature of this analysis, the number of facilities in this parametric change 
research effort is considerably more inclusive than the forecast model generation effort. 


INSTALLATION 

Adak Naval Air Facility 

Agana Naval Air Station 

Alameda Naval Air Station 

Barbers Point Naval Air Station 

Barstow Marine Corps Logistics Base 

Cecil Field Naval Air Station 

Charlseton Naval Shipyard & Naval Station 

Chase Field Naval Air Station 

Corpus Christi Naval Air Station 

Dallas Naval Air Station 

Davisville Naval Construction Battalion Center 

Driver Naval Radio Transmitting Facility 

El Toro Marine Corps Air Station 

Glenview Naval Air Station 

Guam Naval Activities 

Guam Naval Ship Repair Facility 

Guam Fleet and Industrial Supply Center 

Guam Public Works Center 

Hunters Point Annex Naval Station 

Keyport Naval Undersea Warfare Center 

Key West Naval Air Station 


INSTALLATION 

Lakehurst Naval Air Engineering Center 
Long Beach Naval Station 
Long Beach Naval Shipyard 
Mare Island Naval Shipyard 
Memphis Naval Support Activity 
Midway Naval Air Facility 
Moffett Field Naval Air Station 
Newport Naval Education and Training Center 
Oakland Fleet and Industrial Supply Center 
Orlando Naval Training Center 
Philadelphia Naval Complex 
San Diego Naval Training Center 
Sand Point (Puget Sound) Naval Station 
Salton Sea Test Range 
Seal Beach Naval Weapons Station 
South Weymouth Naval Air Station 
Treasure Island Naval Station 
Trenton Naval Air Warfare Center 
Tustin Marine Corps Air Station 
Warminster Naval Air Warfare Center 
White Oak Naval Surface Warfare Center 


Table 5-2. DoN BRAC Installations Employed in BRAC Parametric Effects Analysis 
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In addition to evaluating DoN BRAC facilities, three supplementary installation sets 
were established in order to provide comparative parameter trend baselines. The first 
installation set consisted of all DoN non-BRAC facilities that were on, or proposed to be on, 
the EPA’s National Priorities List (NPL). The purpose of this facility grouping was to 
provide a restoration-intensive parametric trend baseline against which changes in DoN 
BRAC installation data could be compared. Each of the 20 installations compiled in this set 
had to meet not only the condition of being a non-BRAC NPL facility, but also had to have 
the requisite parametric data available for the FY89-FY96 time period. A representative mix 
of both USMC and USN facilities are included in this set, embodying many varied installation 
types. The two remaining baselining installation sets consisted of “total” DoN data measures 
(of which the BRAC and non-BRAC facilities are subsets) and “total” DoD data measures 
(includes data from all the services and the Defense Logistics Agency). All four installation 
sets are summarized in Table 5-3 below. 


Installation Set Installation Set Description 

DoN BRAC DoN BRAC facilities with DERP data for period FY89-FY96 

DoN Non-BRAC DoN non-BRAC facilities on, or proposed to be on, the NPL 

Total DoN Totality of DoN’s restoration efforts as reported by the DERP 

Total DoD_Totality of DoD’s restoration efforts as reported by the DERP 


Table 5-3. Installation Sets Employed in BRAC Parametric Effects Analysis 
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The parameters measured for each installation set consisted of restoration data 
covering DoN closures and realignments for BRACs I through IV. It should be noted that 
the Navy was only marginally influenced by BRACI (eight affected facilities), with only three 
facilities receiving any environmental restoration action. Due to this small data pool, no 
meaningful analysis can be garnered from exclusively studying BRAC I facilities. The affected 
three sites, however, are included in the overall DoN BRAC installation set analysis. 

The choice of the actual parameters compiled and analyzed centered largely on, but 
was not limited to, those variables deemed significant restoration cost drivers during forecast 
model formulation. The specific installation set variables measured are itemized in Table 5-4 
below. As was the case in forecast model formulation, the quality and quantity of data 
increased appreciably in the out years, especially in the FY94-FY96 period. 


EXPLANATORY VARIABLES 


Variable 

Symbol 

Total Number of Sites 

Sts(T) 

Number of IRAs Complete or Underway 

Sts(A) 

Sites w/ Design Phase Complete/Underway 

Sts(D) 

Sites w/ Cleanup Phase Complete/Underway 

Sts(C) 

Sites with Response Complete 

Sts(RC) 1 

Unsuitable Acreage 

UnstA 

Installation FFA/IAG Status 

FFA 

Re-Use Plan Status 

R/U 


Table 5-4. Installation Variables Measured in BRAC Parametric Effects Analysis 
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D. ANALYSIS RESULTS FOR BRAC-RELATED PARAMETRIC EFFECTS 


Including the inherent dynamic nature of environmental restoration efforts, the 
establishment of reliable parametric trends for installation data over the FY89-FY96 faced 
several notable challenges throughout the research process. Three of the unique impediments 
to stable trend analysis included DoD’s adoption of a new installation restoration activity 
tracking system in FY92, the impact of implementing the Fast-Track Initiative, and the non¬ 
trivial refinement of DoN installation data in FY95. Each one of these elements corrupted 
consistent trend establishment in various ways and to varying degrees, as described below. 

• During FY92, DoD developed an improved system - the Restoration Management 
Information System (RMIS) - for enhanced tracking of restoration activities. A 
majority of DoD’s cleanup work by FY92 was aimed at stabilizing sites that posed 
the greatest dangers to health and the environment. This stabilization work 
involved Interim Remedial Actions (IRAs) that were not separately accounted for 
prior to FY92. [Ref 39] As a consequence, reporting was initiated for the new 
category of IRAs and the previously reported category of Remedial Actions (RAs) 
was adjusted significantly downward to account for the segregation of IRAs. 

• The inclusion of an additional site category, coupled with improved information 
management, led to an abrupt program-wide increase in FY92 Total Sites (Sts(T)). 
The impact to DoN was even more pronounced, perhaps due to the Navy’s 
considerable use of Interim Remedial Actions (IRAs) in the unique wetlands, 
estuarine, and marine environments adjacent to DoN installations [Ref 40]. 

• As stated in Chapter H, the most critical recent environmental restoration initiative 
was bom out of the President’s 1993 five part Community Reinvestment Program. 
The Fast Track Cleanup Initiative, one of five major initiatives in the plan, was a 
leading force in DoD environmental restoration endeavors beginning in FY94. 
DoD immediately developed several Fast Track implementation strategies to focus 
each service on accelerating environmental restoration progress [Ref 41]. 

• DoN data underwent a larger than normal refinement in FY95 to revise parameter 
totals that were previously categorized incorrectly after having discovered some 
duplicative accounting and inappropriate classification of actions based on strict 
BRAC program definitions [Ref. 42]. Although all DoN facilities were affected, 
BRAC parameters appeared to bear the weight of the adjustments. 
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For each of the explanatory variables listed in Table 5-4, installation parametric data 
were compiled for each installation set over the maximum number of years figures were 
available. From the compilation of raw data, a yearly growth rate (Per Year % Growth) and 
a cumulative growth rate (Cumulative % Growth) were calculated for each installation set in 
order to establish individual installation set trend lines. 

In general, the DoN BRAC installation set was compared to the other three sets to 
evaluate the parametric effects over time, if any, of BRAC proceedings. Not only was the 
DoN BRAC installation set evaluated as a whole, but data for BRAC rounds II, III, and IV 
were individually evaluated to ascertain any specific timing effects. The year immediately 
preceding BRAC initiation and the three subsequent years following BRAC initiation were 
focused on in the comparative analysis. The subsections that follow specify the results of the 
comprehensive trend analysis on the key installation parameters. 

1. Total Number of Sites - “Sts(T)” 

An installation’s Total Number of Sites - Sts(T) - proved to be the most significant 
quantitative explanatory variable in forecast model formulation and thus is a meaningful 
parameter in predicting environmental costs at DoN BRAC facilities. As a result, Sts(T) was 
examined to measure the effects of BRAC proceedings in order to better predict its 
contribution to forecast model estimations. Graph 5-1 on the following page charts the 
cumulative yearly growth rate (Cumulative % Growth) in Sts(T) at each of the four 
installation sets. 
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Growth in Total Sites - Sts(T) 



DoN BRAC 
DoN Total 


-DoN Non-BRAC 

- DoD Total 


Graph 5-1. Cumulative Yearly Growth for Sts(T) Parameter 


The most general observation that can be made from Graph 5-1 is that as the BRAC 
process matures, the growth of DoN BRAC sites outpace the other three installation sets in 
the out years after having lagged behind in the early research years. Intuitively, this result is 
expected, considering the relative undeveloped nature of the BRAC process in the earlier 
study years coupled with the more recent interest in BRAC progress as the regulatory timeline 
requirements become decisive. 

A more detailed analysis of individual yearly growth rates reveals important features 
of the environmental restoration program affecting multiple installation sets in this, and other, 
parameter evaluations. For example, the abrupt increase in Sts(T) for the Navy installation 
sets (DoN BRAC, DoN Non-BRAC, and Total DoN) in FY92 can be attributed to the 
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aforementioned initiation of the RMIS, which divided and reclassified key site categories 
recurrently utilized in DoN restoration practices. 

The across-the-board rise in Sts(T) during FY94 and the continued growth in FY95 
has been credited to DoD’s efforts in implementing the President’s 1993 five part Community 
Reinvestment Program. DoD quickly codified the program’s concepts to guide the services 
in rapidly altering their practices to meet the challenges set forth in the President’s plan. 

The apparent growth stagnation for DoN installation sets (especially the DoN BRAC 
set) during FY95 can be ascribed to the Navy’s refinement of both BRAC and DERA site 
information. As highlighted previously, DoN data underwent a larger than normal adjustment 
in FY95 that all but eliminated any real growth in DoN Sts(T) progress. DoN revised 
parameter totals that were previously categorized incorrectly or erroneously duplicated. DoN 
BRAC parameters were the most statistically impacted. 

Segregating the DoN BRAC installation set into BRAC round constituents (BRACs 
n, in, and rV) exposed critical facts about the timing of BRAC parametric effects. Per year 
growth analysis revealed that the most significant yearly gain in the Sts(T) parameter for DoN 
BRAC facilities occurred during the first fiill fiscal year following BRAC initiation. 
Additionally, the gain for the respective DoN BRAC installations the year following their 
BRAC commencement outpaced the yearly growth of all other installation sets, with the 
exception of BRAC DI. Although BRAC III did not exceed growth of some sets in FY94 it 
did post its highest yearly gain since FY92. Table 5-5 on the following page highlights this 
particular point. 
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Sts(T) % Growth 

BRAG II 

DoN BRAG 

DoN non-BRAG 

Total DoN 

Total DoD 

FY92 

40.0 % 

31.0% 

26.0 % 

35.0 % 

6.0 % 


BRAG III 

DoN BRAG 

DoN non-BRAG 

Total DoN 

Total DoD 

FY94 

13.0% 

12.0% 

26.0 % 

14.0 % 

9.0 % 


BRAG IV 

DoN BRAG 

DoN non-BRAC 

Total DoN 

Total DoD 

FY96 

8.0 % 

2.0 % 

5.0 % 

3.0 % 

3.0% 


Table 5-5. Growth of Total Sites (Sts(T)) per BRAG Round. 


Despite the numerous restoration factors precipitating year-to-year inconsistencies, 
it appears that the Total Sites parameter - Sts(T) - at DoN BRAG installations grows at a 
greater rate when compared to any other facility set. The major unique restoration program 
developments and initiatives tend to affect all DoD installations in roughly similar ways, thus 
allowing DoN BRAG facilities to maintain their growth advantage during dynamic times. 

In estimating the effects of BRAG on the Sts(T) parameter, some very general guides 
can be inferred from this research analysis. First, and foremost, BRAG historical data 
undeniably establish that the first full fiscal year after BRAG initiation is the most significant 
growth period for BRAG installations and generally outpaces other facilities for that year. 
BRAG facilities averaged roughly a 20% growth in Sts(T) in the first year following BRAG 
initiation as opposed to roughly a 14% growth in Sts(T) for all other installation sets in 
comparable years. Secondly, overall DoN BRAG growth for the FY89-96 period averaged 
roughly 16% compared to roughly 13% for non-BRAG facilities over the same time period. 


70 
















2 . 


Sites with Cleanup Phase Complete or Underway - “Sts(C)” 


Meaningful analysis of the Sts(C) parameter included data from only FY92-FY96 due 
to the previously mentioned FY92-initiated RMIS tracking system. Prior to FY92, the Sts(C) 
category included some actions that are now classified as Interim Remedial Actions. Because 
of this, the Sts(C) variable dropped appreciably from FY91 to FY92 due to the adjustment. 

Analyzing the growth of cleanup activities among the four installation sets 
demonstrates the advancing maturity level of BRAC activities. The DoN BRAC installation 
set has lagged the Sts(C) growth (see Graph 5-2 below) in all but the Total DoD set. The 
delayed growth may be attributed to the relatively less developed nature of DoN BRAC 
cleanup actions in light of the Navy only being significantly impacted by BRAC in FY91. 


Growth in Cleanup Actions 



DoN BRAC-DoN Non-BRAC 

DoN Totals ' DoD Totals 


Graph 5-2. Cumulative Yearly Growth for the Sts(C) Parameter 
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As explained in a previous section of this chapter, the cleanup phase of a BRAC action 
occurs many years after the BRAC round assumes force of law but all restoration actions 
must be complete within six years. Consequently, it may be this impending BRAC time 
requirement that accounts for the recent (FY95-FY96) spikes in Sts(C) activity (see Graph 
5-2 on previous page). In fact, the DoN BRAC set had the highest yearly growth rate for 
Sts(C) in both FY95 and FY96. 

To further examine the timing issues of cleanup growth, the DoN BRAC installation 
set was again segregated into its BRAC round constituents, but only for BRACs II and III 
(being that BRAC IV occurred too recently to judge cleanup progress). Resultantly, BRAC 
n (FY91) showed significant Sts(C) growth starting in FY94 and peaking in FY95 (a 250% 
growth that year). BRAC III (FY93) showed significant Sts(C) growth starting in FY96 
which is expected to continue in FY97. Additionally, both BRAC II and III DoN data 
significantly outpaced the Sts(C) parameter growth for all other installation sets in those peak 
years, as illustrated in the Table 5-6 below. 


Sts(C) % Growth 

BRAC II 

DoN BRAC 

DoN non-BRAC 

Total DoN 

Total DoD 

FY94 

117.0% 

4.0 % 

98.0 % 

96.0 % 

31.0% 

FY95 

250.0 % 

148.0 % 

59.0 % 

61.0% 

46.0 % 


BRAC III 

DoN BRAC 

DoN non-BRAC 

Total DoN 

Total DoD 

FY96 

107.0% 

76.0 % 

20.0 % 

45.0 % 

78.0 % 


Table 5-6. Growth of Cleanup Actions (Sts(C)) per BRAC Round. 
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In estimating the effects of BRAC on the Sts(C) parameter, it can be concluded that 
an initial spike in cleanup activities, as measured by progress in the Sts(C) data, occurs in the 
third full year following BRAC initiation. For example, BRAC II assumed force of law in 
FY91 but did not see a precipitous increase in cleanup activity until FY94. Similarly, BRAC 
III assumed force of law in FY93 but did not see its significant increase in cleanup activity 
until FY96. During the year of spiked activity, both BRAC facilities sets more than doubled 
their number of Sts(C) from the previous year. 

However, a note of caution about the Sts(C) analysis is warranted. First, the inclusion 
of only the BRAC II and III rounds may not represent the overall BRAC cleanup trend 
(although BRAC III is the round that affected DoN the most and includes the bulk of the 
available data). In addition, the cleanup process at DoN BRAC installations is still somewhat 
in its infancy, having several more years to complete its cleanup requirements. Consequently, 
examination of cleanup data for the upcoming several years will facilitate a more confident 
determination of the timing and scope of DoN BRAC cleanup activities. 

3. Unsuitable Acreage - “UnstA” 

The Unsuitable Acreage parameter was one of the quantitative variables proved by 
forecast model formulation to be a significant cost driver in the restoration process. Trend 
analysis on this parameter was severely hampered by lack of data. Acreage data needed for 
the Unsuitable Acreage calculation was not available until FY94 and only then for selected 
installations. In fact, no data was available for any facilities within the DoN non-BRAC 
installation set. Resultantly, only general trend assertions can be made on the limited data. 
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For DoN BRAC installations, Unsuitable Acreage decreased nearly 11% over the 
FY94-FY96 time period. Over two-thirds of the DoN BRAC facilities experienced lower 
Unsuitable Acreage levels in successive years. Contrarily, approximately 10% of the DoN 
BRAC facilities saw a rising Unsuitable Acreage level, most likely due to site reevaluation by 
regulators. In contrast, the total DoN and DoD installation sets experienced Unsuitable 
Acreage grmth in the FY94-FY96 period. Unsuitable Acreage growth can most readily be 
attributed to an increase in new “unclean” DoD facilities over the time period, coupled with 
the recent prioritization assigned to BRAC installation property turnover. 

4. Re-Use Plan Status (“R/U”) & Installation FFA/IAG Status (“FFA”) 

Of the four qualitative explanatory variables determined to be significant restoration 
costs drivers, only two - Re-Use Plan Status (R/U) and Installation FFA/IAG Status (FFA) - 
lend themselves to parametric trend analysis. The other two significant qualitative variables 
are strictly installation specific and thus are not influenced by BRAC actions or BRAC timing. 
Logically, this qualitative parameter analysis was confined to the DoN BRAC installation set. 

Examining the R/U parameter revealed that only roughly half (20) of the facilities in 
the DoN BRAC installation set had tenable Re-Use Plans through FY96. Not surprisingly, 
the majority of facilities without Re-Use plans are from the most recent BRAC round (BRAC 
IV in FY95). Determining the timing for R/U data is crucial to effective estimation, 
considering it is one of the most statistically significant of all the qualitative explanatory 
variables. In regards to the timing issue, of the facilities with Re-Use plans, 10 achieved this 
milestone within two years and 16 within three years of BRAC initiation. The “average” time 
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to complete a Re-Use plan was just less than 2.5 years. Conservatively, an estimating 
guideline of three years for the inclusion of the R/U explanatory variable within the forecast 
model following a BRAC initiation is the most reliable parametric trend prediction value. 

The analysis of the FFA parameter produced far less clear-cut trends than did R/U 
variable analysis. Of the 16 DoN BRAC facilities having FFA’s, only five (5) of the facilities 
did not also have a coinciding NPL designation. Interestingly enough, each of the five DoN 
BRAC non-NPL facilities with signed FFA’s were in California, attesting to the premium 
consideration extended to cooperative efforts with what is viewed as distinctly stringent 
outside regulators. As far as the estimative value of the FFA variable analysis, no reliable 
guidelines could be adopted. The FFA explanatory variable, however, is a pivotal element 
of the forecast model in that its presence represents a potential cost savings versus an 
otherwise parametrically identical facility without such an agreement. For this reason, each 
facility must be evaluated on an individual basis to determine the inclusion and timing of the 
FFA variable in the forecast model. 

5. Additional Parametric Measures 

The preceding subsections detailed the BRAC initiation trend analysis for the most 
meaningful explanatory variables, that is, those variables proven to be statistically significant 
cost drivers utilized in forecasting restoration expenditures. However, as shown previously 
in Table 5-4, several other variables were included in the analysis of parametric effects from 
BRAC initiation. Examination of the remaining variables - Interim Removal Actions (IRAs); 
Remedial Designs (RD); and Responses Complete (RC) - exposed many unattributable 
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inconsistencies from year-to-year across all installation sets, perhaps explaining their lack of 
contribution in forecast model formulation. A broad view of these “later stage” restoration 
parameters over the entire study period is required to smooth the erratic trends and provide 
a basis for general conclusions. From this broader view, it appears the more developed and 
cleanup-intensive DoN non-BRAC installation set (i.e., NPL facilities) far outpaced the 
parameter growth of the other installation sets in these “later stage” measures. The newly 
emerging DoN BRAC installation set cleanup requirements translated to a comparatively 
lagged later stage parameter growth that was gaining substantial momentum in FY95-FY96. 

6. Dependent Variables 

The goal of forecast model formulation is to accurately estimate cost based on certain 
explanatory installation variables. In turn, the cost of environmental restoration may be the 
single most important determinant of programmatic trends available. One of the benefits of 
BRAC parametric effect trend analysis on cost data is to provide clearer evidence of program 
trends over time and help corroborate the assertions made about the effects on the 
explanatory installation parameters. 

As discussed in Chapter III, the current general growth trend of environmental 
restoration funding is to the downside for the program as a whole. Simultaneously, there is 
a concerted DoD effort to assign higher priority to the more expensive cleanup actions in lieu 
of less costly, but more time consuming, investigative actions. The depiction of Total 
Cumulative Restoration Cost ($TC) per year growth in Graph 5-3 on the following page 
vividly illustrates both the general decreasing growth trend in funding coupled with the 
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relative expanding growth of BRAC activities in recent years. Specifically, the rapidly 
increasing growth in the DoN BRAC installation set may owe its relative strength to the 
prioritization given to cleanup efforts, the impending BRAC timeline requirements, and 
heightened interest in expeditiously turning over BRAC property. 

Per Year %Growth in $TC 

SO¬ 
SO -■ 

I 40 - 

IH 

C3 

^ 30 - 

u 
o 
u 

>^20 - 
Ul 

V 
(U 

10 - 
0^ 

FY93 FY94 FY95 FY96 

H Don BRAC H DoN Non-BRAC ■ DoD Totals 

Graph 5-3. Per Year Growth in Total Cumulative Restoration Cost ($TC) 

Although only $TC is represented in Graph 5-3, the Investigation Category Cost (SIC) 
and Cleanup Category Cost (SCC) graphical representations are nearly identical in shape, 
trend and relative installation set strength. Additionally, the inclusion of only the FY93-FY96 
time period was necessary due to the lack of cost data for all installation sets prior to FY92. 
Akin to the $TC data, the SIC and SCC graphs show the general reduction in per year growth 
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from FY93-FY96 with the DoN BRAC installation set significantly outgrowing the other sets 
in FY95 and FY96. Additionally, the per year growth in $CC outpaced SIC per year growth 
by roughly 400% in FY95 and FY96, lending credibility to DoD’s recent initiative in placing 
greater emphasis on cleanup actions. 

As was the case for explanatory variable analysis, the DoN BRAC installation set was 
segregated into its BRAC round constituents (BRACs II, III, and IV) to demonstrate the 
timing effects of the BRAC process on the dependent cost variables. In particular, the 
analysis of SIC and STC provided validation for the general presumption derived from the 
Sts(T) evaluation. To restate the presumption, the most significant growth, and a growth that 
outpaces all other installations, occurs in the first full fiscal year following BRAC initiation. 

Mirroring the relative growth superiority of DoN BRAC Sts(T) data in the first fiscal 
year following BRAC initiation, the growth of both the BRAC III and BRAC IV SIC and 
STC data far outpaced the other installation sets in their respective first fiscal years following 
BRAC action, as depicted in Tables 5-7 and 5-8. In addition, each SIC and STC data value 
listed in Tables 5-7 and 5-8 for the BRAC III and IV rounds represented their single highest 
yearly growth rate over the time period studied. 


SIC %Growth: 

BRAC III 

DoN BRAC 

DoN non-BRAC 

- 

Total DoD 

FY94 

53.0% 

41.0% 

27.0 % 

25.0 % 


BRACIV 

DoN BRAC 

DoN non-BRAC 

Total DoD 

FY96 

27.0 % 

13.0% 

11.0% 

9.0 % 


Table 5-7. Yearly Growth of SIC per BRAC Round 
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$TC yoGrowth: 

BRAC III 

DoN BRAC 

DoN non-BRAC 

Total DoD 

FY94 

63.0 % 

46.0 % 

47.0 % 

39.0 % 


BRACIV 

DoN BRAC 

DoN non-BRAC 

Total DoD 

FY96 

39.0 % 

24.0 % 

17.0% 

20.0 % 


Table 5-8. Yearly Growth of $TC per BRAC Round 


Analogous to previously developed cleanup activity trends, the evaluation of the 
Cleanup category costs ($CC) exhibited distinct BRAC-specific timing patterns in growth. 
Identical to the Sts(C) analysis, the BRAC II (FY91) $CC parameter experienced significant 
growth starting in FY94 and reach its peak in FY95. Correspondingly, the BRAC III (FY93) 
$CC parameter experienced significant growth starting in FY96 which, like the Sts(C) 
analysis, is expected to continue in FY97. Additionally, both BRAC II and III DoN $CC data 
generally outpaced the $CC parameter growth for most other installations in their respective 
peak years, as illustrated in the Table 5-9. Of note, the relative strength of the DoN non- 
BRAC installation set epitomizes the progress of restoration actions at matured NPL facilities. 


5CC %Growth: 

BRAC II 

DoN BRAC 

DoN non-BRAC 

Total DoD 

FY94 

48.0 % 

67.0 % 

99.0 % 

63.0% 

FY95 

62.0 % 

63.0 % 

42.0 % 

40.0 % 

$CC %Growth: 

BRAC III 

DoN BRAC 

DoN non-BRAC 

Total DoD 

FY96 

63.0 % 

49.0 % 

25.0 % 

32.0 % 


Table 5-9. Yearly Growth of Cleanup Category Cost ($CC) per BRAC Round 
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7. 


Closure versus Realignment & Major versus Minor 


To accurately characterize the effects of the BRAC process, each BRAC round subset 
of the DoN BRAC installation set was further subdivided into closure versus realignment 
facilities and major versus minor facilities. This process was undertaken to examine the 
independently attributable influences, if any, related uniquely to the type of BRAC action. 

The comparison of closures versus realignments data resulted in no discernible 
difference in growth rates or parameter timings between the two characterizations within a 
BRAC round. The comparison of major versus minor facilities data also resulted in 
surprisingly similar parameter growth, despite the amount of minor facilities within a BRAC 
round being substantially less than that of major facilities. From these results, it appears the 
discussions of BRAC parametric effects can most effectively be constrained to a BRAC round 
as a whole unit, consisting of all facilities affected by the particular BRAC legislation. This 
supposition greatly enhances the envisioned broad applicability of the forecast model and 
provides for greater flexibility in implementing the relatively uncomplicated computational 
forecast model program. 


E. SUMMARY 

The effects of BRAC initiation on an installation are multi-faceted and repercussive. 
Of particular interest is the magnitude and timing of changes to environmental restoration 
parameters as a result of BRAC initiation. It is theorized that the initiation of a BRAC action 
has a profound effect on installation parameters, accelerating a facility’s environmental 
restoration timetable and resulting in elevated expenditure rates and resource consumption. 
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The objective in fulfilling this research question is to determine the key installation 
parameters that appear sensitive to the initiation of BRAC. In an attempt to establish and 
quantify the effects of BRAC initiation on a facility’s environmental parameters, the analysis 
of parametric change encompassed the full range of available DoN BRAC installation data 
for FY89 through FY96. The data were analyzed to determine what general effects are 
experienced by installation parameters after BRAC initiation, what is the timing of the 
noticeable parametric effects, and are the effects related uniquely to the type of BRAC action. 

In addition to evaluating DoN BRAC facilities, three supplementary installation sets 
were established in order to provide comparative parameter trend baselines. The additional 
installation sets consisted of all DoN non-BRAC facilities that were on (or proposed to be on) 
the EPA’s National Priorities List (NPL), Total DoN installation data measures (of which the 
BRAC and non-BRAC facilities are subsets), and Total DoD data measures (includes data 
from all the services and the Defense Logistics Agency). 

The selection of the actual parameters compiled and analyzed centered largely on 
those variables that were determined to be significant restoration cost drivers during forecast 
model formulation. As was the case in forecast model formulation, the quality and quantity 
of data increased appreciably in the out years, especially in the FY94-FY96 period. As a 
result, much of the parametric trend analysis was hampered by poor quality or unavailability 
of installation data in the early years. 

For the chosen variables to be analyzed, the parametric data were compiled for each 
installation set over the maximum amount of years figures were available. From the 
compilation of raw data, a yearly growth rate and a cumulative growth rate were calculated 
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for each installation set in order to establish individual installation set trend lines. In general, 
the DoN BRAC installation set was compared to the other three sets to evaluate the 
parametric effects over time, if any, of BRAC proceedings. Not only was the DoN BRAC 
installation set evaluated as a whole, but data for BRAC rounds II, III, and IV were 
individually evaluated to ascertain any specific timing effects. 

This chapter explored the quantifiable effects of BRAC initiation on installation 
variables. Several general parametric trends have become evident through the analysis of the 
installation data. The general trends are presented below as installation parameter “rules of 
thumb”. The “rules of thumb” are to be utilized in incorporating the parametric effects 
precipitated by the conduct of BRAC proceedings into the forecast model. It is important to 
realize these general trends are rough approximations based on the analysis of limited data. 


• The first full fiscal year after BRAC initiation is the most significant “Total Number 
of Sites (Sts(T))” parameter growth period for DoN BRAC installations. 
Additionally, DoN BRAC Sts(T) growth outpaced the Sts(T) growth of all other 
installation sets in each respective year following the BRAC initiations. 

• DoN BRAC facilities averaged roughly 20% growth in Sts(T) in the first year 
following each BRAC initiation compared to only 14% growth for all other 
facilities. 

• Overall DoN BRAC Sts(T) growth for the FY89-96 period averaged roughly 16% 
compared to roughly 13% for all other facilities over the same time period. 

• The DoN BRAC installation set had the highest yearly growth rate for the “Sites 
with Cleanup Phase Complete or Underway (Sts(C))” parameter in both FY95 and 
FY96, most likely due to impending BRAC time requirements on cleanup. 

• An initial spike in DoN BRAC cleanup activities, as measured by progress in the 
Sts(C) data, occurs in the third full year following each BRAC initiation. 
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• During the year when Sts(C) initial spikes occurred, DoN BRAC facilities more 
than doubled their number of Sts(C) from the previous year. 

• DoN BRAC “Unsuitable Acreage (UnstA)” tended to decrease by roughly 10% 
per year in FY95-FY96 (based on the limited data available for calculating UnstA). 

• The “average” time to complete a DoN BRAC Re-Use plan was roughly 2.5 years. 

• Conservatively, a three year estimate for the inclusion of the RAJ explanatory 
variable in the forecast model following a BRAC initiation is the most reliable trend 
prediction. 

• The analysis of BRAC effects on the “Federal Facilities Agreement (FFA)” variable 
produced no reliable guidelines. The FFA variable, however, is a pivotal element 
of the forecast model. For this reason, each facility must be evaluated on an 
individual basis to determine the inclusion and timing of the FFA variable in the 
forecast model. 

• The comparison of closures versus realignments and major versus minor facilities 
resulted in strikingly similar parameter growth. As a result, parametric guidelines 
are equally attributable for any type of BRAC action on any facility size. 


The application of the parameter deltas to current/previous installation parameters will 
result in revised “expected” installation parameters. As detailed in Chapter VI, the revised 
parameter values can then be entered into the developed forecast model to predict costs 
associated with the effects of BRAC actions. The results of this chapter were generated 
through a painstaking and frustrating data collection process that merits and requires more 
in-depth installation-by-installation analysis to become a more reliable input to the cost 
estimation process. 
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VI. FORECAST MODEL IMPLEMENTATION & VALIDATION 


A. BACKGROUND 

Preceding chapters have established an extensive and solid foundation from which to 
analyze Base Realignment and Closure (BRAC) environmental restoration activities. Detailed 
presentations included explanations of influential BRAC activities and procedures, the 
development of an environmental restoration cost forecast model, and the quantification of 
installation parametric effects brought about by the initiation of BRAC action. The purpose 
of this chapter is to incorporate all the previously developed concepts in a credible and usable 
fashion. To meet the objectives, the chapter is arranged into three main sections: 

• A spreadsheet-based implementation procedure for the developed forecast model 

• A predictive strength validation analysis for the developed forecast model 

• An approach to using forecast model methodology for broader DoD applications 

B. FORECAST MODEL IMPLEMENTATION PROCEDURE 

The function of this section is to present a usable methodology for the implementation 
of the developed forecast model. The presentation utilizes a columnar, “spreadsheet” format 
for the data entry of installation parameters and the calculation of forecast values from the 
generated regression equation. The structure of the spreadsheet and the required calculations 
are relatively simple and can be easily adapted to any spreadsheet program such as 
Microsoft’s Excel™, Lotus’ 1-2-3™, or Novell’s Quattro® Pro™. 
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The basic template for effectively administering the developed forecast model is 
displayed in Table 6-1 below. The letter symbols refer to spreadsheet columns and the 
numeric symbols refer to spreadsheet rows. The required actions necessary to fill in the 
spreadsheet blocks are detailed in the subsections that follow. 



A 

B 

c 

D 

E 

F 

G 

H 

I 

J 

1 

Instltn 

StstT') 

Sts(C) 

UnstA 

CA? 

NPL 

FFA 

RAJ 

loetfSTC) 

Model Est. 

2 

(input) 

(input) 

(input) 

(input) 

(input) 

(input) 

(input) 

(input) 

(formula) 

(formula) 

3 












Table 6-1. Spreadsheet Template for Implementing the Developed Forecast Model 

1. Installation Parameters 

Since the developed forecast model is a predictive instrument of future expenditures, 
several parametric extrapolations or estimates are required. The best case scenario would 
include reliable parameter estimates from an installation’s resident BRAC Environmental 
Coordinator (BEC). In theory, the estimates supplied by the BEC would be the most 
representative of future expected restoration activities. 

In the absence of such estimates, the current year’s installation data needs to be 
estimated through an extrapolation process employing the parametric “rules-of-thumb” 
developed in Chapter V. For example. Chapter V analysis shows that the DoN BRAC Sts(T) 
installation parameter increases by roughly 16% in a year. This empirically determined yearly 
growth rate would be applied to the current year’s Sts(T) figure to estimate the next year’s 
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Sts(T) spreadsheet input value. The same type of estimation approach can be applied to all 
current installation parameters via the guidelines expressed in Chapter V. Subsection B.4. 
that follows illustrates a functional example of installation parameter estimation. 

2. The ‘iogt($TC)” Calculation 

The “logt($TC)” column uses the inputted parameter estimates in the preceding 
spreadsheet columns to calculate a logt($TC) value. The logt($TC) calculation is based on 
the explanatory variable coefficients derived in forecast model regression analysis. Each 
coeflBcient value is applied to its respective column parameter and then summed to form the 
logt($TC) value. For example, using the developed forecast model coefficient values provided 
by the DoN BRAC regression, the equation to be entered in cell “12” of the spreadsheet (see 
Table 6-1) for parametric data in row 2 is given below. 

The specific variable coefficient values are a generated output of the regression 
process as shown in Appendbc B (i.e., “3.39748” is the regression constant; “0.014169” is the 
partial regression coefficient for the Sts(T) parameter; “0.03877”is the partial regression 
coeflBcient for the UnstA parameter; etc.). In addition. The cell term “B2" refers to column 
B / row 2; the cell term “C2" refers to column C / row 2; etc. The equation for parametric 
data in subsequent rows of the spreadsheet would be identical to the below equation with the 
exception of the column/row suffix. For instance, parametric data in row 3 would have the 
suffix of “3" vice “2" for each column reference (i.e., “ = ...+0.014169*B3+0.03877*C3+..”). 

“ = 3.39748+0.014169*B2+0.03877*C2+0.00011578*D2-i-0.31660*E2-i- 
0.4293*F2+(-0.4597)*G2+0.26135*H2 ” <enter> 
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3. 


The “Model Estimate (Est.)” Calculation 


The “Model Est.” column represents the principal output of the forecast model. To 
calculate and interpret this value properly, it is essential to recall from Chapter IV that a 
dependent variable transformation was required in order to correct an asymmetric $TC 
distribution. In rectifying this asymmetry, a logarithmic (“logt”) transformation of $TC 
proved the most effective data distribution adjustment. The resultant $TC transformation 
manifests itself in both the outputted regression variable coefficients and the calculated 
logt($TC) value. Translating logt($TC) into proper budgetary figures requires a simple re¬ 
transformation of the calculated “logt($TC)” value, yielding a Cumulative Total Restoration 
Cost ($000) value. To accomplish this task, the below equation would be enter in cell “J2” 
of the spreadsheet for parametric data in row 2 (see Table 6-1). Similar to the discussion in 
the previous subsection, the equation for parametric data in subsequent rows of the 
spreadsheet would be identical to the below equation with the exception of the column/row 
suflBx. For instance, parametric data in row 3 would have the suffix of “3" vice “2" for each 
column reference (i.e., “ = 10 13 ”). 

“ = 10 ^ 12 ” <enter> 


4. A Working Illustration 

In order to demonstrate the forecast model spreadsheet implementation process, an 
illustrative example from a DoN BRAC installation is offered. The DoN BRAC installation 
to be estimated is Naval Air Station (NAS) South Weymouth. For purposes of this particular 


88 



example, FY98 Cumulative Total Restoration Cost ($TC) will be forecasted from current 
(FY96) data. NAS South Weymouth’s FY96 installation data is shown in Table 6.2 below. 


Installation 

BRAC 

Sts(T) 

Sts(C) 

UnstA 

CA? 

NPL 

FFA 

RAJ 

NAS South Weymouth 

IV 

12 

2 

1192 

0 

1 

0 

0 


Table 6-2. Spreadsheet Implementation Example - FY96 Installation Data 


In this example we will rely solely on the empirically determined parametric effects 
guidelines, assuming the absence of better quality installation-specific estimates. Applying 
the relevant DoN BRAC effects parametric “rules-of-thumb” of Chapter V, NAS South 
Weymouth’s FY96 installation data will be estimated for FY98 as follows; 


• “Total Number of Sites (Sts(T))” data should grow by roughly 16% per year for 
a cumulative FY98 total of 16. 

FY96data. 12 

^ FY97data. 12+12*(.16) = 13.92 
^ FY98data\ 13.92+13.92*(.16) = 16.14 

• “Sites with Cleanup Phase Complete or Underway (Sts(C))” data should 
experience a near peak value in FY98 due its three year maturity within the BRAC 
process. Applying the third year “doubling” Sts(C) thumb rule, the Sts(C) value 
should increase from 2 in FY96 to approximately 4 in FY98. 

• Unsuitable Acreage (UnstA) may be roughly estimated to decrease by 10% per 
year, although this parameter tends to be more erratic and installation-specific than 
other variables. Applying the yearly 10% reduction, the FY98 UnstA value is 
roughly 965. 

FY96data: 1192 

FY97data: 1192-1192% 10) = 1073 

FY98data. 1073-1073% 10) = 965.5 
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• As discussed in Chapter V, the analysis of BRAC effects on the “Federal Facilities 
Agreement (FFA)” variable produced no reliable general guidelines, therefore FFA 
estimation relies on individual installation data. In NAS South Weymouth’s case, 
a specific review was required and revealed an “on-going” FFA negotiation in 
FY96. As a result, it is likely an FFA will be in place by FY98 and the FFA 
parameter will change state (i.e., from a “0" to a “1"). 

• The Re-Use Status (R/U) parameter will likely change state (i.e., from a “0" to a 
“ 1") based on the “passage of time (three years) since BRAC initiation” rule-of- 
thumb. 

• The CA? and NPL variables are strictly installation-specific and are therefore, 
assumed to have not changed status. 


Summarizing all of the “thumb rule” applications, NAS South Weymouth’s FY98 
installation parameter estimates for forecasting purposes are outlined in Table 6-3. Included 
in the table are a calculated logt($TC) value and a $TC ($000) model estimate. 



A 

B 

c 

D 

E 

F 

G 

H 

I 

J 

1 

Instltn 

StstU 

stsro 

UnstA 

CA? 

NPL 

FFA 

R/U 

logt($TC) 

Model Est. 

2 

So.Wymth 

16 

4 

965 

0 

1 

1 

1 

4.1192 

$13,158 


Table 6-3. Spreadsheet Implementation Example - FY98 Installation Forecast 


The estimated Total Restoration Cost ($TC) forecasted with the developed model 
(“Model Est.”) is $13,158,000 in FY98, representing a 103% increase over FY96's actual 
$TC of $6,469,000. As a means of comparative reference, DoN’s FY98 $TC planning 
estimate for NAS South Weymouth is $14,754,000. 
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c. 


FORECAST MODEL VALIDATION 


In order to confirm the functionality of the developed forecast model for DoN BRAC 
installations, comparative analyses of estimates versus actual costs were undertaken. Both 
the developed forecast model estimates and DoN’s planning estimates were compared against 
actual costs to determine prediction variances. Analysis results are shown in Table 6-4 below. 


Data Year 

Average % Variance- 
(from “Actual” costs) 

Developed Forecast 

Model Estimate 

DoN 

Planning Estimate 

FY96 

“Additive" 

+ 3.67% 

+ 9.43 % 


“Absolute Value" 

22.62 % 

36.79 % 

FY95 

“Additive" 

- 4 94 % 

- 16.94% 


“Absolute Value" 

33.97 % 

42.34 % 


Table 6-4. Comparative Predicted Cost Variance Analysis - DoN Data 


Expenditure data fi'om all 17 installations utilized in forecast model development were 
employed in the comparative analysis. Actual FY95 and FY96 environmental restoration cost 
data came from the respective year’s DERP Annual Report to Congress. Similarly, the cost 
data for “DoN’s Planning Estimate” also came from DERP reports. The “Forecast Model 
Estimate” values were calculated from individual installation parameters utilizing the 
prediction equation generated in forecast model development (as described in Chapter IV). 
Appendix C displays the DoN installation data evaluated in the cost variance analysis. 

As shown in Table 6-4, there are two prediction variance characterizations calculated 
and presented in the comparative analysis. The “Average % Variance - Additive” category 
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is derived from taking a cumulative sum of each installation cost variance percentage and then 
dividing the sum by the number of installations (17, in this case). The “Average % Variance - 
Absolute Value” category is derived from taking the cumulative sum of each installation cost 
variance absolute value percentage and then dividing the sum by the number of installations. 
The difference between the two variance categories lies in the treatment of cost variance 
percentages, as explained below. 

For both DoN and the developed forecast model, prediction values versus actual costs 
deviated across the variance spectrum from underestimating to overestimating. For the 
purposes of this comparative analysis, a negative (-) cost variance percentage indicates an 
underestimation of predicted versus actual cost and a positive (+) cost variance percentage 
indicates an overestimation of predicted versus actual cost. In the “additive” variance 
calculation all installation underestimations (negative variances) and overestimations (positive 
variances) were algebraically summed to give a total variance percentage. 

The relevance of the “additive” category lies in its direct applicability to BRAC 
environmental restoration budgeting. On a macro level, the “additive” category presents the 
overall dollar amount variance (in percent) between aggregate budgeted costs versus 
aggregate actual costs. The overall “additive” variance, therefore, gives a broad measure of 
performance relative to the adequacy of prior planning (i.e., the estimation of future 
restoration work and the budgeting for that work). 

The “additive” category, however, is not without its analytical limitations. In theory, 
a prediction mechanism could wildly underestimate and overestimate costs in such a fashion 
as to have the algebraic sum (as employed in the “additive” case) result in zero variance. To 
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avoid such misrepresentation, the absolute value cost variance percentages were calculated. 
The “absolute value” category simply treats all cost variances the same, regardless of 
underestimation or overestimation. Consequently, the “absolute value” variance analysis may 
be more suited for environmental restoration budgeting at each individual installation. As 
shown in Table 6-4 above, the developed forecast model estimates appear to outperform the 
DoN planning estimates under both the “Additive” and “Absolute Value” cost variance 
categories. 

In an effort to further confirm the developed forecast model as a legitimate cost 
estimating tool, various additional statistical measures were taken on the restoration cost 
variance data. Cost variance data for both the developed forecast model and DoN’s planning 
estimates were compared to show the relative strength of one versus the other. The results 
of the statistical measures are presented in Table 6-5 (FY96) and Table 6-6 (FY95). Akin to 
the “Additive” and “Absolute Value” cost variance comparisons, the developed forecast 
model generally outperformed the DoN planning estimates under these statistical measures. 


ita Year 

Statistical Measure 

Forecast Model Estimate 

DoN Planning Estimate 

FY96 

Median Variance Value 

23.04 % 

25.36 % 


# within 10% Variance 

29.41 % 

11.76% 


# within 25% Variance 

64.71 % 

47.06 % 


# within 50% Variance 

88.24 % 

88.24 % 


Worst Overestimation 

+ 52.40% 

+ 162.39% 


Worst Underestimation 

- 59.45 % 

- 45.79 % 


Table 6-5. Additional Predicted Cost Variance Statistical Measures for FY96 
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Data Year 

Statistical Measure 

Forecast Model Estimate 

DoN Planning Estimate 

FY95 

Median Variance Value 

30.94 % 

43.72 % 


# within 10% Variance 

11.77% 

29.41 % 


# within 25% Variance 

29.41 % 

35.29 % 


# within 50% Variance 

88.24 % 

52.94 % 


Worst Overestimation 

+ 79.71 % 

+ 84.56 % 


Worst Underestimation 

- 77.45 % 

- 84.34 % 


Table 6-6. Additional Predicted Cost Variance Statistical Measures for FY95 


D. APPLYING FORECAST MODEL METHODOLOGY 

To test the broader applicability of the forecast model development methodology, 
certain Department of the Army (“Army”) and Department of the Air Force (“Air Force”) 
installation data were compiled, regressed, and formulated into service-specific forecast 
models. The assembled data consisted of those installation parameters determined to be 
statistically significant through the developed DoN regression process. The same installation 
criteria as employed in developing the DoN BRAC forecast model were also adopted for the 
Army and Air Force installations. Specifically, each eligible installation must be a BRAC I, 
II or III facilities with the required data available over the entire FY94-FY96 period. The 
Army installation set contained 17 facilities and the Air Force installation set contained 18 
facilities. 

Once the required installation data (i.e., Sts(T); Sts(C); Unst A; CA?; NPL; FFA; R/U) 
were gathered, each service’s parameters underwent the same multiple regression procedure 
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against the logarithmically transformed values of $TC as employed in developing the DoN 
forecast model. The resultant explanatory variable regression coefficients were then utilized 
to develop each service’s model estimate equations to be entered in the spreadsheet forecast 
format. Finally, a comparative analysis of the model estimates and each service’s planning 
estimates versus actual costs was conducted in the same fashion as previously described in 
Section C for the DoN model. The results of the comparative analyses are shown in Tables 
6-7 (Army) and 6-8 (Air Force) below. 


Data Year 

Average % Variance- 
(from “Actual” costs) 

Army Forecast 

Model Estimate 

Army 

Planning Estimate 

FY96 

“Additive” 

- 4.20 % 

- 16.19% 


“Absolute Value” 

61.22% 

32.32 % 

FY95 

“Additive” 

+ 8.47 % 

-9.14% 


“Absolute Value” 

49.62 % 

31.61 % 


Table 6-7. Comparative Predicted Cost Variance Analysis - Army Data 


Data Year 

Average % Variance- 
(from “Actual” costs) 

Air Force Forecast 

Model Estimate 

Air Force 

Planning Estimate 

FY96 

“Additive” 

+ 2,01 % 

+ 44.12% 


“Absolute Value” 

41.40% 

44.12% 

FY95 

“Additive” 

+ 14.39% 

-(-61.58% 


“Absolute Value” 

43.18% 

61.58% 


Table 6-8. Comparative Predicted Cost Variance Analysis - Air Force Data 
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The interpretation of the “Average % Variance” categories for Tables 6-7 and 6-8 is 
the same as that described for DoN data following Table 6-4 in Section C. Table 6-7 (Army) 
reveals that, despite the relative success of derived Army forecast model in the “additive” 
variance category. Army planning estimates appear to be more reliable predictors than the 
derived model. Recall that the “additive” variance prediction mechanism is susceptible to 
wildly underestimated and overestimated cost estimates having their algebraic sum (as 
employed in the “additive” case) result in zero variance. The analytical limitation of the 
“additive” variance measures seems to be relevant in this case since the derived forecast 
model’s estimate of Army data shows significantly high “absolute value” variance with 
relatively low “additive” variance. Contrarily, the Army planning estimates show consistently 
low cost variance percentages over both variance measures and are comparable to those seen 
for the developed DoN forecast model on Navy data, suggesting strength in current Army 
estimation practices. 

Analyzing Table 6-8 (Air Force) variance data reveals that neither the derived Air 
Force forecast model nor Air Force planning estimates serve as reliable cost predictors. In 
fact. Air Force planning estimates overestimated actual cost in every instance. 

It is readily apparent that the envisioned broad applicability of the developed DoN 
forecast model cost factors and estimation methodology may not have fully materialized. 
Each service’s derived forecast model cost variances (especially, “absolute value” variances) 
were of significant magnitude to warrant concern as to the reliability of the estimation. The 
derived forecast model estimates were not nearly as accurate as the DoN developed forecast 
model proved to be for DoN facility estimates. 
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In an attempt to account for the apparent lack of true model applicability, several 
observations are oIFered below for the experienced large non-DoN forecast model estimates 
variances of the other services. An obvious distinction between the service installations is 
their past operational history and functions. The previous activities at a facility directly 
contribute to the type and disposition of contamination which, in turn, drives the extent of 
environmental restoration efforts. It may be that the significant cost drivers uncovered during 
the exhaustive DoN forecast model development are not the same cost drivers for the other 
service facilities. Some general operating differences may serve as examples of the varied 
restoration actions required that are dependent on past operations and facility usage. For 
instance, a meaningful percentage of the Army installations under study had significant 
ordnance-related restoration efforts not seen in the Navy or Air Force data. Additionally, due 
to relatively larger land sizes, the Air Force data had inflated (as compared to Navy data) site 
totals and acreage figures not commensurate with inflated total restoration costs. Perhaps 
then, the unique nature of each service’s installations and their equally unique environmental 
restoration requirements demand the exhaustive and iterative development of service-specific 
regression formulas and forecast models. 

E. SUMMARY 

The results of research and forecast model formulation provide an extensive and 
practical foundation from which to analyze BRAC environmental restoration activities. A 
usable methodology for the implementation of the developed DoN forecast model, 
incorporating many of the key developed concepts, serves as the culminating product of the 
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research effort. The implementation procedure presentation utilizes a columnar “spreadsheet” 
format for the inputting of installation parameters and the calculation of forecast values from 
the generated regression equation. The structure of the spreadsheet and the required 
calculations are relatively simple and can be easily adapted to any spreadsheet program. 

Utilizing the forecast model implementation procedure, the developed DoN forecast 
model was employed in a comparative analysis to establish its validity and credibility. The 
results of FY95 and FY96 cost estimate comparisons for Navy installation data provided 
solid substantiation that the developed forecast model is an accurate estimation tool. In fact, 
the developed forecast model outperformed DoN’s planning estimates for the facilities under 
study in the FY95 and FY96 time period. However, despite the relative success of the 
developed forecast model as compared to DoN planning estimates, the cost variance 
percentages are of a considerable enough magnitude to suggest still a better cost prediction 
system is required. Perhaps, there is some value to be gained in more detailed comparisons 
of the developed forecast model and the current systems used in deriving planning estimates. 
The comparisons may uncover significant similarities and/or gross differences that would 
point the way to vital environmental restoration factors to be further scrutinized. 

Regrettably, the envisioned broad applicability of the developed DoN forecast model 
does not appear to extend beyond its employment to DoN facilities. It is clear from the 
results of employing Army and Air Force data into the previously developed structure that 
the statistically significant cost drivers established through the exhaustive regression process 
for DoN data do not necessarily hold true for the other services. 
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Each of the other service’s installations appear to have unique attributes and 
operational histories that make the application of the DoN-specific developed forecast model 
incompatible with another service’s parametric data. An obvious distinction between the 
service installations is their past operational history and functions. The previous activities at 
a facility directly contribute to the type and disposition of contamination which, in turn, drives 
the extent of environmental restoration efforts. 

Some general operating differences may serve as examples for the myriad of required 
restoration actions required are dependent on past operations and facility usage. For instance, 
a meaningful percentage of the Army installations under study had significant ordnance- 
related restoration efforts not seen in the Navy or Air Force data. Additionally, due to 
relatively larger land sizes, the Air Force data had inflated (as compared to Navy data) site 
totals and acreage figures not commensurate with inflated total restoration costs. Perhaps 
then, the unique nature of each service’s installations and their equally unique environmental 
restoration requirements demand the exhaustive and iterative development of service-specific 
regression formulas and forecast models. 

It is important to remember, however, the strength of the developed DoN forecast 
model when applied to Navy data. To parlay the successful DoN implementation, it is 
recommended that Army and Air Force data undergo a similar all-inclusive, iterative 
installation parameter regression process to ascertain the service-specific statistically 
significant cost drivers. Once the entire regression process is employed and each service’s 
key installation parameters are determined, the forecast implementation method should be 
identical to that described for DoN data. 
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Vn. SUMMARY & CONCLUSIONS 


A. INTRODUCTION 

The results of thesis research on environmental restoration activities and expenditure 
modeling have proven to be both insightful and thought-provoking. Every aspect of DoD’s 
environmental restoration activities warrants in-depth evaluation. The examination of specific 
DoN environmental restoration programs related to Base Realignment and Closure (BRAC) 
actions, however, facilitated a more focused and conquerable undertaking. Research efforts 
for the project ranged broadly from various program organizations and functions to the 
validation of an empirically derived restoration expenditure forecast model. As with any 
study of a varied and complex system such as environmental restoration, some areas of 
research raised as many questions as were answered. 

The remainder of the chapter is broken down into three sections. Section B provides 
a succinct summarization of the research project, reviewing the major points for each area of 
concentration. Section C highlights the project’s major research findings. Section D presents 
recommendations for further research and forecast model extension. 

B. RESEARCH SUMMARY 

Presented in the subsections that follow is an abbreviated recapitulation of the 
principal research areas and themes. The summary is intended to highlight the critical issues 
germane to the operation of DoN’s BRAC environmental restoration program. 
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1. 


BRAC and Environmental Restoration 


The U.S. military has faced imposing force structure reductions during the last decade. 
Spurred by the termination of the Cold War and persistent fiscal pressures, military force 
structure and National Security budget authority have decreased 40% in the last ten years. 
Complementing the force structure reductions, though lagging in both extent and duration, 
four rounds of Base Realignment and Closure (BRAC) have been authorized to reduce 
surplus infrastructure. Reducing and realigning base structure allows DoD to avert 
substantial long-term operational costs by eliminating excess capacity. 

As the BRAC process unfolds, environmental cost issues are being placed under ever 
increasing scrutiny by civilian communities, government agencies, and the Congress. Military 
environmental restoration costs have risen sharply (and far above expectations) in recent 
years, with the unanticipated cost growth occurring most visibly for bases on the BRAC lists. 
Specifically, BRAC annual environmental handing for military departments has grown nearly 
threefold from FY91 to FY96, approaching one billion dollars annually. Among the chief 
concerns surrounding BRAC environmental activities are the forecasting of accurate cleanup 
costs, the timing of appropriations coincident with cleanup needs, and the prioritization of 
available cleanup fiands. 

At the heart of the debate is a long-standing DoD policy that excludes environmental 
restoration costs as a factor in the BRAC decision process. Environmental restoration costs 
are not included in DoD’s net present value analysis. Conventional wisdom contends that 
restoration expenditures are “sunk costs” since public law requires military bases to meet 
environmental standards regardless of operating status. What is absent from this contention 


102 


is the accelerated timetable and increased rate of resource consumption necessary to meet 
BRAC timeline requirements and reap prompt BRAC savings. In fact, the alternatives DoD 
foregoes in redirecting limited funding to accelerate environmental restoration have tangible 
value (i.e., opportunity cost) that deserves to be acknowledged as part of a BRAC decision. 

2. The Defense Environmental Restoration Program 

The principal component of the military’s environmental restoration efforts is the 
Defense Environmental Restoration Program (DERP). The DERP provides organizational 
and operational systems crucial to program policy, execution, and oversight. Each service 
component further delineates DERP procedures, management, and implementation through 
its respective chains of command for day-to-day operations. For DoN, the environmental 
restoration implementation responsibilities rest with the Naval Facilities Engineering 
Command (NAVFACENGCOM). For research purposes, one of the most important of the 
many and varied functions of the DERP and NAVFACENGCOM is the classification and 
cataloging of environmental restoration activity data. In analyzing restoration activities, it is 
necessary to recognize functional differences among the categories and phases associated with 
environmental restoration. Each category and phase has certain requirements and procedures 
that uniquely steer its activities and, ultimately, its expenditures and expenditure rate. 

In broad terms, there are two categories (with associated phases) related to 
restoration that are fundamental to this thesis research - Investigation activities and Cleanup 
activities. Generally, the phases of Investigation cover vast amounts of real estate, require 
substantial time to complete, and serve as groundwork for follow-on actions. The Cleanup 
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phases, on the other hand, are characterized by concentrated and high cost end-product 
activities. Recent trends have suggested that the time consuming and sequential Investigation 
activities can be reduced in favor of accelerated and focused Cleanup actions. 

The applicable legislative and regulatory requirements governing the DERP and 
BRAC processes unequivocally underpin program formation and initiatives. The most 
notable regulatory mandates (ordered by relative importance) include; the Comprehensive 
Environmental Response, Compensation, and Liability Act of 1980 (CERCLA); the 
Superfund Amendments and Reauthorization Act of 1986 (SARA); The National 
Environmental Policy Act of 1970 (NEPA); and The Community Environmental Response 
Facilitation Act of 1992 (CERFA). CERCLA and its amendment, SARA, formed the basis 
for the DERP Installation Restoration Program (IRP) process and their mandates created 
much of the existing structure. NEPA requirements drive many of the program operations 
and initiatives to satisfy its evaluation and reporting commitments. CERFA is the most recent 
major legislation affecting BRAC and is responsible for DoD’s parcelization efforts. 

Program initiatives are generally the results of legislative and regulatory compliance 
in a dynamic political and budgetary situation. Examining DERP initiatives reveal trends in 
program composition and operation, ultimately unveiling the environmental restoration cost 
drivers. The sweeping drive to accelerate remediation actions over investigation actions 
notwithstanding, several initiatives dominate the program. The Fast Track Cleanup initiative 
comprises the vast majority of BRAC environmental restoration undertakings. Additionally, 
the recent Relative Risk Reduction Program initiative provides a framework for prioritizing 
work, measuring performance, and justifying requirements and funding. 
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3. 


Environmental Restoration Program Funding 


To fund DoD’s environmental restoration efforts. Congress provides funds in two 
separate accounts - The Defense Environmental Restoration Account (DERA) and the 
environmental subaccount of the Base Closure Account (BCA). The DERA primarily 
incorporates operating installations while the BCA subaccount incorporates closing and 
realigning installations. Although their utilization is strictly segregated by statute, the two 
accounts are organizationally linked. In fact, all of the DoN BRAC installations utilized in 
the forecast model formulation of this thesis consumed DERA funds prior to being placed on 
their respective BRAC lists. 

The BCA furnishes the greatest flexibility in meeting unique and stringent regulatory 
and requirements timeline restrictions for BRAC facilities. Funding for DoD’s BRAC 
environmental restoration comes from one of six BCA subaccounts appropriated by Congress. 
The BCA environmental subaccount is executed by NAVFACENGCOM under the DERP 
in similar fashion to DERA appropriations. The BCA funds are provided in flexible five year 
accounts and the subaccounts are not fenced. There is, however, a statutory ceiling for the 
BCA’s environmental subaccount to limit expenditures for restoration. 

In the last 12 years, nearly $4 billion in environmental restoration funding (DERA and 
BCA) was spent identifying, assessing, and cleaning up past hazardous waste disposal sites 
at both active and BRAC Navy and Marine Corps installations. A significant segment of the 
early DoN DERA funding, especially in the investigation category, was expensed on sites at 
installations subsequently affected by the four rounds of BRAC. The BRAC funds, in the 
form of the BCA environmental subaccount, have been expended by DoN to exclusively fulfill 
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the environmental requirements for the 1,035 BRAC sites on Navy controlled property. The 
bulk of recent DoN BCA environmental funds has supported the cleanup category of the 
restoration program, increasing expenditures in cleanup phases by roughly six times in the last 
few years. DoN’s ability to concentrate BRAC environmental monies on genuine remediation 
is due in large part to both DoD’s “cleanup versus investigation” initiative and the previous 
expenditures of DERA funds on the site investigation phases. 

4. Environmental Restoration Expenditure Forecasting 

The fundamental complexity and multiple attributes of environmental cleanup create 
significant challenges to effective budgeting. Assorted regulatory requirements and the 
uniqueness of individual installations further complicate restoration efforts and proper 
budgetary forecasting. Adding to the predicament, the military departments are accelerating 
environmental cleanup actions in order to expedite suitable property transfer or reuse. 
Without accurate cost forecasting to complement the needed acceleration initiatives, the 
necessary fiscal resources will not be available to foster prompt property turnover and realize 
timely savings. In today’s austere budgetary environment, a reliable expenditure forecasting 
model is essential to accurately demonstrate the resource requirements necessary to complete 
suitable environmental restoration and subsequent transfer/reuse of BRAC lands. 

To achieve the primary thesis objective of constructing a comprehensive, inclusive, 
and functional environmental restoration cost forecasting model, substantial amounts of 
installation data required rigorous analysis and configuration To this end, over 25 separate 
installation statistical parameters were compiled for each of the qualifying 17 DoN BRAC 
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facilities over the most recently available three year period (FY94-FY96). A multiple 
regression technique was employed to manage the extensive data and construct the forecast 
model. Multiple regression is a multifaceted estimating method, quantifying relationships and 
causality among multiple variables in the analysis of empirical data. 


C. MAJOR RESEARCH FINDINGS 

In the process of thesis research and expenditure modeling, several decisive aspects 
of the environmental restoration process have come to light. This section is an extension of 
the research summarization of the previous section and provides a synopsis of the major 
findings established during the research process. The displayed order of the subsection major 
finding descriptions is chronological in relation to the thesis presentation and is not intended 
to suggest relative importance or significance. 

1. A Tenable and Practical Forecast Model 

In creating a realistic and reliable forecast model, the objective was to construct a 
multiple regression model relating environmental restoration costs to several decisive 
explanatory variables. Since there is no certifiable link between environmental restoration 
costs and any exclusive set of installation variables, the regression model approach was 
necessarily an empirical endeavor. To assure complete and conclusive results, an exhaustive 
set of explanatory variable candidates likely to influence environmental restoration costs was 
assembled to systematically construct the forecast model and to test its adequacy of fit. 
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The model formulation strategy consisted of regressing each of the dependent variable 
candidates - Total Cost ($TC), Investigation Cost (SIC); and Cleanup Cost (SCC) - on all the 
explanatory variable candidates. Total variable inclusion ensured no fundamental causal 
variables were omitted from the model. This method permitted examination of the individual 
partial regression coefficients in order to make judgements about the importance of each 
explanatory variable and permitted statistical comparison of successive regression revisions. 

From the all-encompassing initial regression models, systematic statistical reduction 
continued, one explanatory variable at a time, until all remaining variables were statistically 
significant. Parallel to this statistical analysis, each successive regression was evaluated on its 
performance in improving overall model significance. Assessments were based on comparing 
F-statistics, Coefficients of Determination (R-Sq), and Standard Error of Estimates (S) in 
each ensuing regression run. 

Each dependent variable underwent the comprehensive regression model formulation 
process to ensure all plausible combinations of installation data were incorporated. The best 
combination of explanatory variables for each of the dependent variables and, thus the most 
significant forecasting model, proved to be the regression of the Total Cumulative 
Environmental Restoration Cost (Total Cost ($TC)) dependent variable. 

The resultant $TC regression output is the most preferred combination of highest F- 
Statistic, highest R-Sq, and lowest Standard Error of Estimate (S). Deserving of particular 
mention is the remarkably substantial value for the Coefficient of Determination (R-Sq), given 
the purely empirical nature of the regression data. The resultant R-Sq value implies that 75% 
of the variation in Total Cost ($TC) is explained by the assembled dependent variables. 
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2 . 


Significant Environmental Restoration Cost Drivers 


Of the 25 explanatory candidates included in the initial Total Restoration Cost ($TC) 
regression model runs, only seven installation variables proved statistically significant for 
forecasting purposes. The final set of seven explanatory variables contained three quantitative 
variables - Total Sites (Sts(T)); Sites with Cleanup Phase complete or underway (Sts(C)); 
Unsuitable Acreage (UnstA) - and four qualitative variables - Installation State (CA?); NPL 
Status (NPL); FFA Status (FFA); Re-Use Plan Status (R/U)). 

Further comparison of results for each of the three different dependent variable 
regressions highlighted the common cost drivers present in every model. Four explanatory 
variables - Total Sites (Sts(T)); Sites with Cleanup Phase complete or underway (Sts(C)); 
Installation NPL Status (NPL); and Re-Use Plan Status (R/U)) - were significant factors in 
each dependent variable regression, suggesting that these four installation parameters are the 
most universally applicable cost drivers for any type of environmental restoration cost being 
estimated. In comparing the less volatile Investigation Cost and Total Cost regressions, all 
seven explanatory variables listed in the preceding paragraph were statistically significant in 
both cases. Of note, the Installation Type (TYPE) explanatory variable was only slightly 
below the statistical critical value in both the Total Cost and Investigation Cost regressions. 

3. Statistical Insignificance of Relative Risk Program Data 

In an attempt to facilitate inclusion of Relative Risk Site Evaluation parameters, 
additional regressions were performed on each dependent cost variable. DoD’s Relative Risk 
Site Evaluation framework is intended to adjust environmental restoration goals based on a 
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site prioritization basis. Reduced funding levels command DoD to more effectively direct its 
limited resources to sites that pose the greatest threat to human health and the environment. 
The Relative Risk strategy assigns each potentially contaminated site to a high, medium, or 
low risk category. In determining the categorization, the Relative Risk procedure addresses 
several site characteristics, including: specific contaminants present; the significance of 
contamination; contaminant migration pathways; and human and ecological receptors located 
near the site. 

Due to the recent implementation of the Relative Risk program, the regressions 
including Relative Risk data utilized only FY95 and FY96 data. Employing the identical 
formulation process used to build the more inclusive FY94-FY96 model, each dependent 
variable underwent a similar comprehensive regression procedure to ensure all plausible 
combinations of installation data were incorporated. Each regression’s statistical results for 
FY95-96 data were encouragingly similar to the results of the full data (FY94-FY96) 
regression statistical outcomes. As in the full data regressions, the most statistically 
significant results proved to be the regressions on Total Cost ($TC). 

Although the FY95-FY96 regression results go a long way in supporting the 
robustness of the full FY94-FY96 data regression model, an additional major research finding 
is the real success of the FY95-FY96 data test. In each of the regressions on the dependent 
variables, all of the models produced results devoid of the high priority Relative Risk 
parameters - High Priority Sites (Sts(H)) and Medium Priority Sites (Sts(M)) - as statistically 
significant explanatory variables. In fact, the Relative Risk data were not even marginally 
significant in any of the iterative regressions. 
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The statistical insignificance of the Relative Risk data in forecast model formulation 
may be interpreted in two general ways; 

• The cost effects of the Relative Risk measures are already captured by some of the 
variables resident in the developed forecast model and thus, the Relative Risk 
measures become redundant and insignificant variables. 

• The Relative Risk program may not be properly constructed due to being an a 
priori measure based on supposition rather than an empirically based measure. 

When analyzing the Relative Risk program and the developed forecast model it seems 
that Relative Risk characterization procedures (described previously) include assessments on 
installation parameters not captured by the developed forecast model variables. As a result, 
the second interpretation of Relative Risk insignificance (see above) appears more accurate. 
However, with the recent (FY95) implementation of Relative Risk Site Evaluation, the use 
of only the first two years of program data may not be indicative of the future significance 
Relative Risk plays in driving environmental restoration costs. Further research should focus 
on the Relative Risk Site Evaluation initiative to ensure it is meeting its intended purpose. 

4. Parametric Effects Resulting from BRAG Initiation 

The effects of BRAG initiation on an installation are multifaceted and expansive. All 
aspects of the affected facility are thrust into a state of dynamic transformation. Of particular 
interest is the magnitude and timing of changes to environmental restoration parameters as 
a result of BRAG initiation. It is theorized that the initiation of a BRAG action has a 
profound effect on installation parameters, accelerating a facility’s environmental restoration 
timetable and resulting in elevated expenditure rates and resource consumption. 
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In an attempt to establish and quantify the effects of BRAC initiation on a facility’s 
environmental parameters, an analysis of parametric change was conducted. Data included 
the full range of available DoN BRAC data (FY89 - FY96) and were analyzed to determine: 
the general effects experienced by installation parameters after BRAC initiation; the timing 
of the noticeable parametric effects; and the effects related uniquely to the type of BRAC 
action (i.e., major vs. minor; closure vs. realignment). 

In addition to evaluating DoN BRAC facilities, three supplementary installation sets 
were established in order to provide comparative parameter trend baselines. The additional 
installation sets consisted of all DoN non-BRAC facilities that were on (or proposed to be on) 
the EPA’s National Priorities List (NPL), Total DoN installation data measures (of which the 
BRAC and non-BRAC facilities are subsets), and Total DoD data measures (includes data 
from all the services and the Defense Logistics Agency). 

From the compilation of raw data, a yearly growth rate and a cumulative growth rate 
were calculated for each installation set in order to establish individual installation set trend 
lines. In general, the DoN BRAC installation set was compared to the other three sets to 
evaluate the parametric effects over time, if any, of BRAC proceedings. Not only was the 
DoN BRAC installation set evaluated as a whole, but data for BRAC rounds II, III, and IV 
were individually evaluated to ascertain any specific timing effects. 

Several general parametric trends have become evident through the analysis of the 
installation data. The general trends are presented on the following page as installation 
parameter “rules of thumb”. The “rules of thumb” are to be utilized in incorporating the 
parametric effects precipitated by the conduct of BRAC proceedings into the forecast model. 
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• The first full fiscal year after BRAC initiation is the most significant “Total Number 
of Sites (Sts(T))” parameter growth period for DoN BRAC installations. 
Additionally, DoN BRAC Sts(T) growth outpaced the Sts(T) growth of all other 
installation sets in each respective year following the BRAC initiations. 

• DoN BRAC facilities averaged roughly 20% growth in Sts(T) in the first year 
following each BRAC initiation compared to 14% growth for all other facilities. 

• Overall DoN BRAC Sts(T) growth for the FY89-96 period averaged roughly 16% 
compared to roughly 13% for all other facilities over the same time period. 

• The DoN BRAC installation set had the highest yearly growth rate for the “Sites 
with Cleanup Phase Complete or Underway (Sts(C))” parameter in both FY95 and 
FY96, most likely due to impending BRAC time requirements on cleanup. 

• An initial spike in DoN BRAC cleanup activities, as measured by progress in the 
Sts(C) data, occurs in the third full year following each BRAC initiation. 

• During the year when Sts(C) initial spikes occurred, DoN BRAC facilities more 
than doubled their number of Sts(C) from the previous year. 

• DoN BRAC “Unsuitable Acreage (UnstA)” tended to decrease by roughly 10% 
per year in FY95-FY96 (based on the limited data available for calculating UnstA). 

• The “average” time to complete a DoN BRAC Re-Use plan was roughly 2.5 years. 

• The analysis of BRAC effects on the “Federal Facilities Agreement (FFA)” variable 
produced no reliable guidelines. The FFA variable, however, is a pivotal element 
of the forecast model. For this reason, each facility must be individually evaluated 
to determine the inclusion and timing of the FFA variable in the forecast model. 

• The comparison of closures versus realignments and major versus minor facilities 
resulted in strikingly similar parameter growth. As a result, parametric guidelines 
are equally attributable for any type of BRAC action on any facility size. 


The application of the parameter deltas to current/previous installation parameters will 
result in revised “expected” installation parameters. The revised parameter values can then 
be entered into the developed forecast model to predict costs associated with future initiation 
of base closureVealignment. 
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5. 


Validation of the Developed Forecast Model 


The results of research and forecast model formulation provide an extensive and 
practical foundation from which to analyze BRAC environmental restoration activities. A 
usable methodology for implementing the developed forecast model, incorporating many of 
the key developed concepts, serves as the principal output of the research effort. The forecast 
model implementation procedure utilizes a columnar “spreadsheet” format for the data entry 
of installation parameters and the calculation of forecast values from the generated regression 
equation. The structure of the spreadsheet and the required calculations are relatively simple 
and can be easily adapted to any spreadsheet program. 

Utilizing the implementation procedure, the developed DoN forecast model was 
employed in a comparative analysis to establish its validity and credibility. The results of 
FY95 and FY96 cost estimate comparisons for Navy installation data provided solid 
substantiation that the developed forecast model is an accurate estimation tool. The 
developed forecast model outperformed DoN’s planning estimates over many statistical 
measures for the facilities under study in the FY95 and FY96 time period. 

6. Applicability of the Developed Forecast Model 

Regrettably, the envisioned broad applicability of the developed DoN forecast model 
does not appear to extend beyond its employment to DoN facilities. It is clear from the 
results of employing Army and Air Force data into the previously developed forecast model 
structure that the statistically significant cost drivers established through the exhaustive 
regression process for DoN data do not necessarily hold true for the other services. 
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Each of the other service’s installations appear to have unique attributes and 
operational histories that make the application of the DoN-specific developed forecast model 
incompatible with another service’s parametric data. An obvious distinction between the 
service installations is their past operational history and functions. The previous activities at 
a facility directly contribute to the type and disposition of contamination which, in turn, drives 
the extent of environmental restoration efforts. 

Some general operating differences may serve as examples for the myriad of required 
restoration actions that are dependent on past operations and facility usage. For instance, a 
meaningful percentage of the Army installations under study had significant ordnance-related 
restoration efforts not seen in the Navy or Air Force data. Additionally, due to relatively 
larger land sizes, the Air Force data had inflated (as compared to Navy data) site totals and 
acreage figures not commensurate with inflated total restoration costs. Perhaps then, the 
unique nature of each service’s installations and their equally unique environmental restoration 
requirements demands the exhaustive and iterative development of service-specific regression 
formulas and forecast models. 

It is important to remember, however, the strength of the thesis-developed DoN 
forecast model when applied to Navy data. To emulate the successful DoN implementation, 
similar application of the DoN-proven all-inclusive, iterative installation parameter regression 
process techrrique to Army and Air Force data would be beneficial in ascertaining the service- 
specific statistically significant cost drivers. Once the entire regression process is employed 
and each service’s key installation parameters are determined, the forecast implementation 
method should be identical to that described for DoN data. 
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D. RECOMMENDATIONS FOR FURTHER RESEARCH 


Although research efforts have provided considerable insight into DoN’s BRAC 
environmental restoration activities, there remains substantial areas for examination left 
unexplored. In the hopes of initiating further study on DoD’s environmental restoration 
program, several recommendations for further research and forecast model extension are 
assembled below. 

• Enhance the DoN forecast model developed in this thesi.s with the inclusion of 
more recent installation data as it becomes available. The additional data needs to 
be added to the all-inclusive installation parameter database to facilitate an 
expanded comprehensive iterative regression process and obtain the most accurate 
forecast model. The most recent data (FY97) should be available shortly after the 
release date of this project. 

• Apply the DoN-proven technique of an all-inclusive iterative regression on BRAC 
data to the other services (i.e. Army and Air Force). Analysis demonstrated that 
each service appears to have unique restoration requirements based on their past 
operational histories. For this reason, each service must undergo individual 
comprehensive forecast model formulation to determine each service’s significant 
environmental cost drivers. 

• Compare and contrast the current environmental restoration cost estimating 
practices of the services. Data analysis revealed that current Army planning 
estimates appear to outperform current planning estimates of the other services 
when analyzing BRAC installation cost variances. An examination of each 
service’s forecasting system will determine model commonality and facilitate the 
application of “best practice” across service lines. 

• Apply the general developed forecast model methodology to DoD’s Formerly Used 
Defense Sites (FUDS). FUDS are a logical extension of BRAC sites based on 
similarities in unique requirements, timeline constraints, and extensive reliance on 
cooperative agreements. 

• Develop a broader environmental restoration cost forecast model based on 
extensive DoD installation data. Although the bulk of research focused on 
DoD’s/DoN’s BRAC restoration activities, the methodology employed in arriving 
at the developed forecast model is flexible enough to incorporate all types of 
variables and installations. 
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• Investigate the implementation of DoD’s Relative Risk Evaluation Program. In 
each of the DoN regressions on the dependent cost variables, all of the models 
produced results devoid of the high priority Relative Risk parameters as statistically 
significant explanatory variables. In fact, the Relative Risk data were not even 
marginally significant in any of the iterative regressions. With the recent (FY95) 
implementation of the Relative Risk program, the utilization of only the first two 
years of program data may not be indicative of the future significance Relative Risk 
plays in driving environmental restoration costs. As a result, further research must 
focus on the Relative Risk Site Evaluation initiative to ensure it is meeting its 
intended purpose. 

• Broaden the scope of environmental restoration research to include a detailed cost- 
benefit analysis of environmental restoration technology and outsourcing. 
Ultimately, long-term cost control will depend on successfully developing more 
efficient ways to remediate contaminants. 

• Pursue the inclusion of reliable environmental restoration expenditure estimations 
into DoD’s BRAC cost model - Cost of Base Realignment Actions (COBRA) 
model. 
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APPENDIX A. ENVIRONMENTAL RESTORATION INSTALLATION DATA 


This appendix features the entirety of the parametric installation data utilized in 
forecast model formulation. Each data year (FY-94 through FY96) is separately tabulated 
with its corresponding dependent and explanatory variables. Data for all parameters were 
obtained chiefly fi'om the DERP’s Annual Reports to Congress for FY94 through FY96 and 
installation information provided by NAVFACENGrCOM via their Site Base Cleanup Plan 
(BCP) Internet web pages. 
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APPENDIX B. FORECAST MODEL REGRESSION RESULTS 


For purposes of forecast model development, a total of 17 DoN facilities met all the 
selective data conditions. Extensive parametric data were compiled for each of the 17 
facilities over the FY94-FY96 period yielding a total of 51 autonomous data points. Each 
installation data point, over each of the three years, entails multiple explanatory variables with 
which to build the regression model. 

This appendix details the multiple regression statistical results and graphical 
presentations for the environmental restoration forecast model considered to be the most 
significant and reliable estimator. After multiple iterative regressions on all three dependent 
variables over all possible explanatory variable combinations, the $TC model clearly proved 
to be the must statistically significant. The specific estimating model presented in this 
appendix is the multiple regression on the transformed dependent variable of Total 
Cumulative Environmental Restoration Cost (“logt ($TC)”). 

The multiple regression computations and analytical tests were performed using the 
commercially produced MINITAB Statistical Analysis software package. The data and 
graphical representations displayed in this appendix are outputs of the MINITAB system. 
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DISTRIBUTION of TOTAL CUMVLA TIVE RESTORA TION COST ("$TC") 


MTB > hist C2 

Character Histogram 


Histogram 

of $TC 

Midpoint 

Count 

0 

5 

10000 

18 

20000 

10 

30000 

9 

40000 

3 

50000 

2 

60000 

1 

70000 

0 

80000 

1 

90000 

0 

100000 

1 

110000 

1 


N = 51 

★★★★★★★★★ 
★ ★ ★ 

★ ★ 
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DISTRIBUTION of the TRANSFORMA TION OF STC- 


MTB > hist c3 

Character Histogram 


Histogram of logt$TC N = 51 


Midpoint 

3.2 

3.4 

3.6 

3.8 
4.0 

4.2 

4.4 

4.6 

4.8 
5.0 


Count 

1 * 

0 
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g 
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2 ** 


"iogt($Tcy 


124 


FINAL REGRESSION INFORMATION for "$TC" 


info 


Information on the Worksheet 


Column 

Count 

Name 

Cl 

51 

Instaln 

C2 

51 

$TC 

C3 

51 

logt$TC 

C4 

51 

Sts(T) 

C5 

51 

Sts (C) 

C6 

51 

Unst.A 

C7 

51 

CA? 

C6 

51 

NPL 

C9 

51 

FFA 

CIO 

51 

R/U 

C20 

51 

Residual 

C21 

51 

Expctd y 

C22 

51 

norm rsdl 


CORRELATION MATRIX for EXPLANATORY VARIABLES 


corr C4-C10 

Correlations (Pearson) 



Sts (T) 

Sts(C) 

Unst.A 

CA? 

NPL 

FFA 

Sts(C) 

-0.247 






Unst.A 

0.252 

-0.296 





CA? 

0.392 

-0.167 

0.133 




NPL 

0.325 

0.349 

-0.258 

-0.169 



FFA 

0.511 

0.179 

0.149 

0.131 

0.729 


R/U 

0.095 

0.167 

0.120 

0.102 

0.169 

0.266 
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Cl 

C2 

FORECAST 

C3 

‘ MODEL 

C4 

REGRESSION DATA 

C5 C6 

for 

C7 

" $TC " 

C8 

C9 

CIO 


Install! 

$TC 

logt$TC 

Sts(T) 

Sts(C) 

Unst.A 

CA? 

NPL 

FFA 

R/U 

1 

Agana 

18667 

4.27107 

30 

0 

2435 

0 

0 

0 

1 

2 

Alameda 

52461 

4.71984 

30 

4 

2628 

1 

0 

1 

1 

3 

Barbers 

18263 

4.26157 

25 

2 

2542 

0 

0 

0 

0 

4‘; 

Cecil 

16876 

4.22727 

25 

2 

1350 

0 

1 

1 

1 

5 

DavisV 

29927 

4.47606 

25 

7 

776 

0 

1 

1 

1 

6 

El Toro 

35778 

4.55362 

43 

8 

1346 

1 

1 

1 

0 

7 

Glenvw 

11639 

4.06592 

36 

1 

396 

0 

1 

1 

1 

8 

Hunters 

114745 

5.05973 

74 

0 

848 

1 

1 

1 

1 

9 

L.Bch 

24530 

4.38970 

9 

2 

848 

1 

0 

0 

1 

10 

Mare 

34522 

4.53810 

36 

0 

5195 

1 

0 

1 

1 

11 

Moffett 

58269 

4.76544 

34 

7 

583 

1 

1 

1 

1 

12 

Orlando 

7970 

3.90146 

14 

1 

520 

0 

0 

0 

1 

13 

SD ' 

7060 

3.84880 

14 

2 

0 

1 

0 

0 

0 

14 

TI 

8979 

3.95323 

31 

0 

639 

1 

0 

1 

1 

15 

Trenton 

8544 

3.93166 

11 

3 

33 

0 

0 

0 

1 

16 

Tustin 

32221 

4.50814 

28 

3 

82 

1 

0 

0 

1 

17 

Wrmnstr 

11362 

4.05545 

10 

3 

419 

0 

1 

1 

1 

18 

Agana 

17560 

4.24452 

29 

0 

2435 

0 

0 

0 

0 

19 

Alameda 

42519 

4.62858 

30 

0 

2634 

1 

0 

1 

0 

20 

Barbers 

18259 

4.26148 

23 

0 

2542 

0 

0 

0 

0 

21 

Cecil 

12785 

4.10670 

25 

3 

1415 

0 

1 

1 

1 

22 

DavisV 

25107 

4.39979 

24 

5 

776 

0 

1 

1 

1 

23 

El Toro 

30146 

4.47923 

43 

0 

1784 

1 

1 

1 

0 

24 

Glenvw 

6394 

3.80577 

35 

0 

922 

0 

1 

1 

0 

25 

Hunters 

96785 

4.98581 

63 

0 

848 

1 

1 

1 

1 

26 

L.Bch 

17199 

4.23550 

8 

1 

779 

1 

0 

0 

1 

27 

Mare 

30901 

4.48997 

35 

0 

5503 

1 

0 

1 

1 

28 

Moffett 

52190 

4.71759 

32 

3 

1186 

1 

1 

1 

1 

29 

Orlando 

7365 

3.86717 

15 

1 

521 

0 

0 

0 

0 

30 

SD 

5412 

3.73336 

13 

2 
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1 

0 

0 

0 

3i 

TI 

7238 

3.85962 

31 

0 

689 

1 

0 

1 

0 

32 

Trenton 

6936 

3.84111 

11 

4 

33 

0 

0 

0 

0 

33 

Tustin 

31680 

4.50079 

37 

0 

82 

1 

0 

0 

0 

34 

Wrmnstr 

5966 

3.77568 

10 

9 

373 

0 

1 

1 

0 

35 

Agana 

8362 

3.92231 

23 

0 

2435 

0 

0 

0 

0 

36 

Alameda 

29483 

4.46957 

24 

0 

2496 

1 

0 

0 

0 

37 

Barbers 

14349 

4.15682 

21 

0 

2699 

0 

0 

0 

0 

38 

Cecil 

6165 

3.78993 

25 

2 

1413 

0 

1 

1 

0 

39 

DavisV 

20693 

4.31582 

23 

4 

1130 

0 

1 

1 

1 

40 

El Toro 

22101 

4.34441 

25 

0 

1038 

1 

1 

1 

0 

41 

Glenvw 

4793 

3.68061 

30 

0 

942 

0 

1 

1 

0 

42 

Hunters 

78536 

4.89507 

64 

0 

888 

1 

1 

1 

0 

43 

L.Bch 

13049 

4.11558 

9 

1 

1288 

1 

0 

0 

1 

44 

Mare 

26634 

4.42544 

42 

0 

5420 

1 

0 

1 

1 

45 

Moffett 

44645 

4.64977 

32 

0 
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1 

1 

1 

1 

46 

Orlando 

1831 

3.26269 

15 

0 

821 

0 

0 

0 

0 

47 

SD 

3585 

3.55449 

7 

2 

112 

1 

0 

0 

0 

48 

TI 

4605 

3.66323 

51 

0 

1048 

1 

0 

1 

0 

49 

Trenton 

5781 

3.76200 

11 

2 

28 

0 

0 

0 

0 

50 

Tustin 

19481 

4.28961 

32 

1 

1383 
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0 

51 
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4149 

3.61794 

10 

1 

417 
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MULTIPLE REGRESSION RESULTS for TRANSFORMED STC - ^logt(STC )'' 


MTB > regr c3 7 c4 c5 c6 c7 c8 c9 clO c20 c21; 
SUBC> xlof; 

SUBC> dw. 

Regression Analysis 


The regression equation is 

logt$TC = 3.39 + 0.0142 Sts(T) + 0.0388 Sts(C) +0.000116 Unst.A + 0.317 CA? 
+ 0.429 NPL - 0.460 FFA + 0.261 R/U 


Predictor 

Coef 

StDev 

T 

P 

Constant 

3.39478 

0.08250 

41.15 

0.000 

Sts(T) 

0.014169 

0,002905 

4.88 

0.000 

Sts(C) 

0.03877 

0.01605 

2.42 

0.020 

Unst.A 0, 

.00011578 

0.00002966 

3.90 

0.000 

CA? 

0.31660 

0.07344 

4.31 

0.000 

NPL 

0.4293 

0.1205 

3.56 

0.001 

FFA 

-0.4597 

0.1135 

-4.05 

0.000 

R/U 

0.26135 

0.06380 

4.10 

0.000 

S = 0.2143 

R-Sq 

= 75.1% 

R-Sq(adj) = 

71.1% 

Analysis of 

Variance 




Source 

DF 

SS 

MS 

F 

Regression 

7 5 

.96901 0 

.85272 

18.57 

Error 

43 1 

.97493 0 

.04593 


Total 

50 7 

.94394 



Source 

DF 

Seq SS 



Sts(T) 

1 3 

.15284 



Sts(C) 

1 0 

.36115 



Unst.A 

1 0 

.38570 



CA? 

1 0 

.59449 



NPL 

1 0 

.10282 



FFA 

1 0 

.60140 



R/U 

1 0 

.77060 




Unusual Observations 


Obs 

Sts(T) 

logt$TC 

Fit 

StDev Fit 

Residual 

St Resid 

19 

30.0 

4.6286 

3.9817 

0.0877 

0.6469 

3.31R 

46 

15.0 

3.2627 

3.7024 

0.0619 

-0.4397 

-2.14R 

48 

51.0 

3.6632 

4.0956 

0.1125 

-0.4324 

-2.37R 


R denotes an observation with a large standardized residual 
Durbin-Watson statistic = 1.78 
Lack of fit test 

Possible interactions with variable Unst.A (P = 0.059) 
Overall lack of fit test is significant at P = 0.059 
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"RESIDUAL versus FIT" PLOT 


- Certain assumptions are asserted and tested during regression model construction. The assumptions 
provide the justification for the widespread applicability of the regression method. Meeting the regression 
assumptions validates that the resulting model estimators are unbiased, consistent, and efficient. Thus, an 
understanding of these assumptions is vital so that regression modeling can be employed and analyzed in 
the proper manner. 

- The validity of two of the key regression assumptions - Linearity & Homoscedasticity - is confirmed 
by the examination of a regression's "Residual versus Fit" plot. The Linearity assumption states that the 
dependent variable is linearly related to each of the explanatory variables. The Homoscedasticity 
assumption states that the error terms are assumed to have a finite variance that is constant for all given 
values of explanatory variables. 

- The "Residual versus Fit" plot, as shown below, removes the effect of the regression line and thus, 
amplifies the underlying patterns difficult to detect when the regression line dominates. The "Residual 
versus Fit" plot allows us to pinpoint violations of Linearity & Homoscedasticity by showing model 
characteristics not normally captured in a plot of dependent versus explanatory variables. In anaylzing a 
"Residual versus Fit" plot, a random pattern of errors shows the linearity of the model was entirely 
captured in the dependent to explanatory variable relationship. Therefore, a random pattern as displayed 
below, validates the Linearity & Homoscedasticity (or Constant Variance) assumptions. 

(Note; Numbers within the graph denote multiple data points) 


plot c20 c21 
Character Plot 


Residual- 


2.0 + 


0.0 + 


- 2.0 + 


* 


★ 


2 


* 


* 



★ ★ 

★ ** 2 
* 2 * ★★★ 

* * 

* 


2 


•k 


* 



* 


-+-+-+-+-+-+ --Expctd Y 

3.60 3.90 4.20 4.50 4.80 5.10 
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"NORMAL PROBABILITY" PLOT 


- Certain assumptions are asserted and tested during regression model construction. The assumptions 
provide the justification for the widespread applicability of the regression method. Meeting the regression 
assumptions validate that the resulting model estimators are unbiased, consistent, and efficient. Thus, an 
understanding of these assumptions is vital so that regression modeling can be employed and analyzed in 
the proper manner. 

- The validity of a key regression assumption - Normality of Error Distribution - is confirmed by the 
examination of a regression's "Normal Probability" plot. The Normality of Error Distribution assumption 
states that the error terms from a properly conducted regression estimation should be normally distributed. 
Since error terms are a composite of many factors not included in the regression equation, it is reasonable 
to expect that many of these factors may tend to offset each other. This offsetting effect is exactly the 
pattern described by a normal probability curve. The factors affecting the regression include model errors 
(i.e., measurement, model specification, causality errors) or irregular errors (i.e., cyclical fluctuations or 
budgetary fluctuations). If many of these factors are unrelated, one form of Central Limit theorem assures 
that their joint effects (represented by error terms) will be normally distributed. 

- The "Normal Probability" plot (see below) tests the normality of the residuals distribution. To 
construct the plot, normal scores ("nscore") are calculated for the error terms of the regression equation. 
The normal scores are then plotted against the error terms. If the residuals are from a normally distributed 
population, then a "residual versus normal scores" plot will lie roughly in a straight 45 degree line. Thus, 
a roughly 45 degree straight line, as seen below, validates the Normality of Error Distribution assumption. 
(Note; Numbers within the graph denote multiple data points) 

nscore c20 c22 
plot c20 c22 

Character Plot 

Residual- * 


2 . 0 + 


0.0 + 


- 2.0 + 


222 ** 2 ** 


22 * 


"232 


2 * 2 * 


2**22 


-+-+-+.+..+.norm rsd 

- 2.0 - 1.0 0.0 1.0 2.0 


corr c20 c22 

Correlation of Residual and norm rsdl = 0.981 
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APPENDIX C. FORECAST MODEL VALIDATION DATA AND RESULTS 


In order to confirm the functionality of the developed forecast model for DoN BRAC 
installations, comparative analysis of estimated versus actual costs was undertaken. Both the 
developed forecast model estimates and DoN’s planning estimates were compared against 
actual costs to determine prediction variances. 

Expenditure data fi'om all 17 installations utilized in forecast model development were 
employed in the comparative analysis. Actual FY95 and FY96 environmental restoration cost 
data came from the respective year’s DERP Annual Report to Congress. Similarly, the cost 
data for “DoN’s Planning Estimate” also came from DERP reports. The “Forecast Model 
Estimate” values were calculated from individual installation parameters utilizing the 
prediction equation generated in forecast model development (as described in Chapter IV). 

This appendbc displays the installation data compiled and evaluated in the forecasted 
environmental restoration cost variance comparative analyses. 
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